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Socio-Psychological Factors in Industrial Morale: II 


Raymond E. Bernberg 


Los Angeles State College 


Previously reported research (1) compared 
the predictive ability of different tests of mo- 
rale for performance indicators in the work 
situation. The tests of morale were based 
upon current concepts; viz.: group morale 
(GM); employee attitude toward the com- 
pany (CM) (i.e., acceptance of the formal 
organization by its members); rating of the 
supervisors by the workers (S); and self- 
rating of morale by the workers (SM). _ Per- 
formance indicators used were absences, tar- 
diness, short time absences, medical-aid unit 
visits, and merit rating. The results indicated 
a general failing of all tests of morale to have 


Table 1 


Intercorrelations of the Tests of Morale 


CM S SM 
GM ae a .67 
CM AF 47 
S : 48 49 
SM 7 47 


much predictive value for any of the perform- 
ance indicators.' 

An interesting result showed up when SM 
(a thermometer scale requesting the worker 
to check along a O to 100-degree parameter 
with verbal referents the degree to which he 
agreed with the proposition that his work 
group had high morale exemplified by their 
working together as a well organized team) 
was taken as a criterion and a determination 


1 This conclusion is in conflict with the multiple 
correlation of .71 between six objective indices of 
efficiency and morale scores. See Giese, J. G., and 
Ruter, H. W. An objective analysis of morale. J. 
appl. Psychol., 1949, 33, 421-428.—Editor. 


made of the predictive value the other three 
tests of morale had for it. 

Table 1 contains the Pearson product mo- 
ment intercorrelations of the four measures 
based upon 890 cases. ‘The results of the 
multiple regression analysis are in Table 2. 
It appears that GM with a correlation of plus 
.67 with SM has contributed almost the en- 
tirety of the multiple R of plus .69. 

This result gives much validity to the con- 
cept of morale as a group phenomenon as 
measured by the group morale test. This, of 
course, is based upon the assumption that the 
collective opinions of the workers themselves 

Table 2 
Beta Weights and Multiple R with SM as Criterion 


1 (GM) 2 (CM) 3(S 


71 16 16 


= .69; gRoiw = .02 


are an adequate criterion for appraising mo 
rale in the work situation. 

The group morale test (2) is a projective 
type paper and pencil test using the direc- 
tion of perception technique of attitude meas- 
urement. It is based upon content derived 
from six determiners discussed by Krech and 
Crutchfield (4). They are: 1) positive goals; 
2) satisfaction of accessory needs; 3) sense of 
advance toward goals; 4) level of aspiration 
and achievement; 5) time perspective; and 
6) feelings of identification, solidarity, and 
involvement. There are 34 items in the test, 
all equally weighted. 

The question which presented itself next 
was: If this test with its total content has 
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such a high relationship with the collective 
opinion of workers concerning their cognition 
of morale in their work group, which items 
with their specific content comprise the maxi- 
mal possible prediction for the test as a 
whole? This is an analytical question which 
in essence asks: What do the workers mean 
by morale? This of course concerns only the 
relationship of the content of the items of the 
test and the criterion. 

Gengerelli (3) has developed a technique 
of analysis whereby one may reduce a large 
battery of tests in their relation to a criterion, 
to a number of sub-tests which provide the 
maximal prediction of the criterion. This 
method describes the whole battery in terms 
of the smaller sub-set and provides a regres- 
sion equation to express the total correlation 


Table 3 


Intercorrelations of the Four “Factors” 
(Items) and SM 











Item S} 9 
SM ; 14 
3 ‘ — 16 
9 ‘ - 
11 a 00 12 
18 j —.14 —.34 


matrix. He states that this method yields the 
sub-tests as empirical tests which might be 
considered as “factors” of a sort. This pro- 
vides an immediate practical solution to an- 
swer the analytical question posed above. 

The SM measure was taken as the criterion 
and the 34 items of the GM test as the bat- 
tery of tests for the analysis. Because of the 
large number of cases, 100 of the 890 were 
selected randomly for determining the inter- 
correlations between the items (tetrachoric r) 
and the correlations between the items and 
the criterion (bi-serial r). 

The results of the analysis produced 4 fac- 
tors which as a sub-set have a multiple R 
plus .96 with the criterion. Table 3 shows 
the intercorrelations between these items and 
with the criterion. Table 4 indicates their 
beta weights. 
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Table 4 
Beta Weights and Multiple R with SM as Criterion 





4 
(Item 18) 


820 


3 
(Item 11) 


130 


2 
(Item 9) 


“419 


1 
(Item 3) 
218 


Ro. = .96; cRoiwmn = .09. 

These four “factors” are the following items 
of the test: Item 3. “Scientific studies show 
that in groups such as yours, if you wanted 
to hold a big party, picnic or other type of 
friendly gathering, you would not care to in- 
vite: (a) 60% of your work group; (b) 35% 
of your work group. Item 9. “Statistics show 
continually that the increase in group produc- 
tion is a result of: (a) group effort toward 
step-up; (b) individual effort. Item 11. “Re- 
cent industrial studies have shown that the 
following percentage of workers in a group 
such as yours gives a good amount of atten- 
tion to ways of getting ahead: (a) 60%; (b) 
90%. Item 18. “A recent poll of workers in 
groups such as yours found that workers got 
a lot of satisfaction from working together: 
(a) infrequently; (b) frequently.” 

The possible importance of these findings 
need not lie in the measurement of morale 
per se. It appears that it would be wise in 
developing and controlling work groups to 
consider the following factors: (1) satisfac- 
tion of men from working together; (2) in- 
crease in production as a result of group ef- 
fort; (3) intimacy of workers with each other 
beyond as well as in the work surroundings; 
and (4) the individual level of aspiration in 
getting ahead. 


Received October 3, 1952. 
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Predicting Success in Dental School 


Wilbur L. Layton 


Student Counseling Bureau, University of Minnesota 


During the past several years, a trend in 
the field of testing has been indicated by 
the establishment of nation-wide testing pro- 
grams in which applicants for admission to 
certain schools, mainly professional schools, 
are tested in centralized programs. All par- 
ticipating colleges or schools then use the re- 
sulting test scores in the process of selecting 
and admitting students. 

However, a test battery which is valid as 
a selection device at one institution may not 
be valid at another institution. Rarely do 
the administrators of the national testing 
programs publish validity data pertaining to 
specific institutions. Hence most institutions 
participating in a national program are doing 
so blindly unless they evaluate the test bat- 
tery in their own situation. 

Since the fall of 1946, the School of Den- 
tistry at the University of Minnesota has 
participated in the testing program sponsored 
by the Council on Dental Education of the 
American Dental Association by testing fresh- 
man classes at the beginning of the school 
year. During the first five years of this test- 
ing program, an attempt was made to deter- 
mine the relationship between various tests 
administered in the program and success in 
Dental School. In 1951 the Council on Den- 
tal Education decided that the test battery 
currently used was adequate and should be 
used by dental schools to select students for 
their freshman classes. However, little evi- 
dence was available locally to indicate the 
usefulness of the battery for selection pur- 
poses. 

Consequently, a study was designed that 
would correlate pre-dental grades and the test 
data available through the national program 
with grades earned by dental school fresh- 
men who entered the University of Minnesota 
Dental School in the years 1946 through 
1949. First year grades in the dental school 
were the primary criteria for each of the four 
classes. For the freshman class entering in 
1946 four year grades were also available as 


criteria. Separate grades in freshman courses 
in physiological chemistry, anatomy and 
prosthetics were also used as criteria for all 
four classes studied. These data were punched 
into Hollerith cards to facilitate analysis. 

Table 1 presents the means and standard 
deviations for the data which were available 
for the classes entering in the various years 
1946 through 1949. Table 1 indicates that 
the tests included in the battery varied from 
year to year. The battery was stabilized in 
1949. This battery is the one currently 
(1952) being used in the national program. 

The ACE is the American Council on Edu- 
cation psychoiogical examination. It is one 
of the most widely used scholastic aptitude 
tests. It provides three scores,—a linguistic 
or L score, a quantitative or Q score, and a 
total score. Only the total score was used in 
this investigation. 

The Survey of Object Visualization is simi- 
lar in content to the Revised Minnesota Pa- 
per Form Board. The Survey of Natural Sci- 
ences is a 90-item test measuring facts and 
applications of principles in biology, chem- 
istry and physics. The total raw score was 
used in the analyses. 

The Carving Dexterity test is a chalk carv- 
ing test developed by the Council on Dental 
Education. The examinee uses a knife, ruler 
and pencil to carve a piece of chalk which 
measures approximately 314,” in length and 
»."" in diameter to correspond to an illus- 
trated figure. The carvings are graded by 
judges on the basis of objectives such as: 
“flatness of surfaces,” “clean-cutness of an- 
gles,” “symmetry” and “accuracy of repro- 
duction.” The test supposedly measures 
finger-knife dexterity as well as spatial visu- 
alization. 

GED No. 3 is the USAFI test of General 
Educational Development test three, “Inter- 
pretation of Reading Materials in the Natu- 
ral Sciences.” It measures speed of reading 
and comprehension of passages in the natural 
sciences. In 1947, 1948 and 1949 only the 
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Table 1 


Means and Standard Deviations of Criteria and Predictive Variables for Groups Entering the 
Dental School in 1946, 1947, 1948 and 1949 


1946 
N = 81 
M 


131.9 
13.3 
29.2 


S.D. 
20.9 
3.1 
7.4 


ACE 

Carving 

Survey of Obj. Vis. 

Survey of Sciences 

GED No. 3 

GED No. 1A 

GED No. 1B 

Mich. Vocabulary 
Phys. Science 
Biol. Science , 

Peterson Word Dex. 

Pre-dent. HPR** 

Frosh HPR** 

Four year HPR** 

Anatomy HPR** 

Phys. Chem. HPR** 

Prosthetics HPR** 


1 


55.5 
16.6 
82.2 


12.1 
4.0 
11.4 


3.8 


* Not given. 
** HPR = 


honor points 
number of credits 


first 45 out of the total 90 items were given. 

GED No. 1 is the USAFI test of General 
Educational Development test one, ‘“Correct- 
ness and Effectiveness of Expression.” It con- 
sists of a section on spelling and a section in 


Table 2 


Coetlicients of Various Predictive Indices with Fresh- 


man and Cumulative (4 year) Honor Point Ratios 
in the Dental School for the 81 Students 
in the Class Entering in 1946 


Freshman 


Grades Grades 


8&3 
09 
10 
27 
24 
25 
12 
19 
A9 
31 

11 


Predictor 


Freshman HPR 

ACE Total 

GED Reading 

GED No. 1A 

GED No. 1B 

Word Dexterity 

Mich. Vocab. (Phys. Science) 
Mich. Vocab. (Biol. Science) 
Survey Obj. Vis. 

Carving 

Pre-dental HPR 


AS 
.23 
40 
40 
29 
.29 
ae 

14 
22 


40 


Four Year 


1949 
N =-88 


M 


134.1 
11.8 
30.9 
55.3 
34.7 


1947 
N = 80 


M 


36.3 
11.4 
28.9 
55.4 
34.0 
16.0 
83.2 


S.D. S.D. 


15.9 
2.6 
6.4 
8.0 
5.3 
4.0 

11.1 


17.5 
2.9 
iS 
9.0 


3.2 


(A = 3; B = 2;C = 1; D, F = 0 honor points). 


which corrections are to be made in punctua- 
tion, words and phrases in a connected text. 
In Table 1, A is the score on the spelling sec- 
tion of the test; B is the score on the total 
test. 

The Michigan Vocabulary is the Michi- 
gan Vocabulary Profile’ test. The two parts 
“physical science vocabulary” and “biologi- 
cal science vocabulary” were included in the 
test battery in 1946. 

The Peterson Word Dexterity test meas- 
ures specifically the extent to which the stu- 
dent knows the meaning of certain suffixes 
and prefixes and measures “dexterity” at ma- 
nipulating word parts and word meanings. 

Coefficients of correlation between the pre- 
dictive indices and total first year grades and 
grades in the three first year courses in the 
Dental School were computed for all four 
groups. Four year grades for the group en- 
tering in 1946 were correlated with the pre- 
dictive indices also. 

A multiple correlation and a_ regression 
equation were computed for the 1949 group. 
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Table 3 


Correlation 


Coefficients of the Various Predictive Indices with Freshman Honor Point Ratio in the 


Dental School for Classes Entering in 1946 Through 1949 


Criterion: 
Freshman 
HPR 


ACE 
(Total) 


1946 15 14 .22 
1947 13 38 20 
1948 i 29 .21 
1949 34 2 18 


Carv- 
ing 


t Not given in 1946 


* Only } of test given to 1947, 1948 and 1949 groups. 


This group was selected because it was given 
the tests currently being given in the battery. 
These tests presumably are the most valid on 
a nationwide basis. 

Table 2 presents the coefficients of correla- 
tion between the predictive indices and fresh- 
man and four year grades for the class enter- 
ing in 1946. With an N of 81 the standard 
error of r if the true 7 is zero is .11 

Freshman grades correlated rather highly 
(r = .83) with total four year grades. It is 
interesting to note that the correlations of the 


predictive variables with four year grades are 


smaller than those with freshman grades 
alone. However, the Survey of Object Visu- 
alization and Carving Dexterity tests are more 
highly related to four year grades. This may 
be due to the small number of courses requir- 
ing these skills that are given during the first 
two years of the curriculum. The last two 
years of the curriculum are heavily loaded 
with practicum and clinic courses which re- 
quire these skills of the students. 

Table 3 presents the correlation coefficients 
for various predictive indices for each of four 


Survey 
of GED 


Sciencest No. 3* HPR 


.23 40 81 
43 37 27 80 
A7 — 01 84 
43 34 42 R88 


Pre 


dent No. of 


( “‘ases 


classes with freshman honor point ratio in the 
dental school. Tests given in Table 3 are the 
tests which are currently used in the National 
Testing Program plus the pre-dental honor 
point ratio. 

In three of the four years (1947 being the 
exception) the pre-dental honor point ratio 
was the best predictor of freshman honor point 
ratios in the dental school. The group enter- 
ing in 1947 was heavily loaded with veteran 
students who had taken their pre-dental work 
before the war. The difference in motivation 
for these students in their pre-war school work 
and their post-war school work may account 
for the relatively lower correlation in the 1947 
group. The findings of Hansen and Paterson 
(1) that there is a “striking increase in post- 
war scholastic achievement as compared with 
pre-war scholastic achievement of the same 
students” (all veterans) tend to support this 
interpretation. It is interesting to note that 
the ACE score did not correlate highly with 
freshman honor point ratio in the first three 
classes studied, but did for the group enter 
ing in 1949. The Survey of Sciences test cor 


Table 4 


Intercorrelations of the Variables for the 88 Students in the Class Entering the Dental School in 1949 


ACE 
Total 


Survey of 

Object Vis. 
34 .29 

ACE Total .20 

Survey of Object Vis 

Carving Dexterity 

Survey of Sciences 

GED No. 3 


Carving 


Survey of 
Dexterity 


Sciences 


GED Pre-dental 

No. 3 HPR 

18 43 34 42 

17 37 43 Al 

at 02 

17 Al 

46 .28 
.24 
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Table 5 


Correlations of Honor Point Ratios in Oral Anatomy 50-51-52, Prosthetics 50-51-52, Physiology 58-59 
with Five Predictive Measures for Four Classes of Dental School Freshmen 


a. Oral anatomy 50-51-52 HPR with: 
1. Pre-dental HPR 
2. ACE Total 
3. Survey of Obj. Vis. 
4. Carving 
5. Survey of Sciences 
6. GED No. 3 
. Prosthetics 50-51-52 HPR with: 
1. Pre-dental HPR 
2. ACE Total 
3. Survey of Obj. Vis. 
4. Carving 
5. Survey of Sciences 
6. GED No. 3 
c. Physiology 58-59 HPR with: 
1. Pre-dental HPR 
. ACE Total 
. Survey of Obj. Vis. 
. Carving 
5. Survey of Sciences 
6. GED No. 3 


1946 
N = 81 
37 
aa 
35 
42 
08 
.28 


21 
.29 


45 
.22 


07 
18 


14 





1949 
N = 85 


1947 
N = 86 


1948 
N = 90 





Al 
37 
34 
.24 
38 
.27 


.26 
.08 
32 
30 
~ 18 
1 


Al 
.20 
29 
1 
49 
09 


.25 
04 
1 
.22 
05 

50 


t Survey of Sciences Test was not given to the Freshman Class in 1946. 


relates higher with first year honor point ratio 
for the 1947 class and for the 1949 class than 
for the 1948 class. 

The fluctuation of the coefficients of cor- 
relation from year to year may be due to the 
differences from year to year in the means 
and standard deviations for the variables and 
hence differences in the composition of the 
classes. Changes in the curriculum could also 
account for the variability of the correlation 
coefficients. Also, because of the small num- 
ber of cases studied in the various classes, this 
variation may be only random variation. 

The class entering in 1949 was used for the 
computation of intercorrelations of the sev- 
eral variables, a coefficient of multiple correla- 
tion and a regression equation. 

Table 4 presents the intercorrelation of the 
variables studied. 

The regression equation and coefficient of 
multiple correlation were computed by the 
Doolittle method. Of the six predictor vari- 
ables only two, Survey of Sciences and pre- 
dental HPR, yielded significant Beta coeffi- 


cients. The coefficient of multiple correlation 
obtained was .54. 
The regression equation is: 


G = .02 X, + 39 X,—.29. 


X, = Survey of Sciences total raw score; 
X. = Pre-dental HPR; 
9 = Predicted freshman year honor point 
ratio. 


Table 5 presents the coefficients of correla- 
tion between five predictive indices and honor 
point ratios in oral anatomy, prosthetics and 
physiological chemistry for the years 1946 
through 1949, 

The coefficients of correlation presented in 
Table 5 also fluctuate by variable and by 
year. This variation may be due to random 
sampling error, actual changes in the makeup 
of the classes or changes in the curriculum. 


Discussion 


It would appear that the five tests currently 
retained in the national testing program of 
the Council of Dental Education of the Ameri- 
can Dental Association are not highly related 





Predicting Success in Dental School 


to grades earned by students in the University 
of Minnesota Dental School. The ACE test 
and the carving test are not predictive of first 
year honor point ratios in the course areas 
where they might be expected to have some 
relationship. Weiss (3) has reported results 
very similar to those presented here. He 
found that pre-dental grades and part of the 
Survey of Sciences test gave moderately high 
correlations with theory and technic grades. 
Peterson (2) has reported some validity co- 
efficients for this test battery. The correla- 
tions which he reports are consistently higher 
than the ones obtained in the present study. 
Hence, the present study and that of Weiss 
illustrate the need for local validation of 
tests used in national testing programs. Tests 
which appeared fairly good on a nationwide 
basis did not show up well in the two dental 
schools studied. 
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These studies also show the variability in 
coefficients of correlation one can obtain when 
several groups are studied. This means that 
findings based on one group or a nationwide 
study should be applied with caution in work- 
ing with another group for counseling or ad- 
mission purposes. The use of test data should 
be tempered by careful consideration of all 
other available data. 


Received August 25, 1952. 


References 


1. Hansen, L. M. and Paterson, D. G. 
achievement of veterans. 
69, 195-197. 

2. Peterson, S. Forecasting the success of freshman 
dental students through the aptitude testing 
program. J. Amer. Dent. Assn., 1948, 37, 
259-265. 

3. Weiss, I. Predicting academic success in dental 
school. J. appl. Psychol., 1952, 36, 11-14 


Scholastic 
Sch. & Soc., 1949, 





THE JOURNAL OF ApPLinpn PsycHoLocy 
Vol. 37, No. 4, 1953 
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Scarvia B. Anderson 


George Peabody College for Teachers 2 


Attempts to predict college “success” have 
been so numerous in recent years that it is a 
rare freshman indeed who has not been sub- 
jected to a testing program of one sort or an- 
other. The battery of tests used in the pres- 
ent study may be distinguished from hundreds 
of similar batteries chiefly in that it includes 
two very easy practice tests which do not 
seem prima facie to belong with the other 
more conventional placement tests. The ques- 
tions which we shall attempt to answer here 
are “What value do these practice tests have 
in predicting freshman grade point ratio?” 
and “How does this value compare with the 
predictive values of the other tests in the 
battery?” 

The original decision to use practice tests 
in the freshman testing program at George 
Peabody College for Teachers was based upon 
the belief that within a group of entering 
freshmen there would be wide variability in 
“test-wiseness” and ensuing diminished re- 
liability of test scores. We reasoned, on the 
basis of observations in previous years, that 
some of the freshmen would have had no ex- 
perience with objective tests and that many 
of the students would not be familiar with 
the use of special pencils and separate ma- 
chine-scored answer sheets." 

It was felt that a preliminary testing situa- 
tion would serve two useful purposes: it would 
aid the students to become:more skillful tech- 
nically, and thus to concentrate their later ef- 

‘forts on the subject matter of the placement 

tests rather than on the mechanics; and it 
would perhaps relieve some of their tensions 
and anxieties. 


'Dr. Julian C. Stanley, George Peabody College 
for Teachers, offered helpful suggestions and criticisms 
during the preparation of this article. 

2 The author is now associated with the Naval Re- 
search Laboratory. 

$It was determined later from the freshmen who 
were tested that only one-half had previously used 
separate answer sheets and special pencils, and that 
the majority of these had used them only once in a 
State testing program. 


The tests selected for practice tests were 
Otis Quick-Scoring Mental Ability Tests: 
Beta Tests, Forms Cm and Dm. These tests 
were designed for grades 4-9, so it was 
thought that very few, if any, of the Peabody 
freshmen would have had any experience with 
the tests for at least four years. 

For each of the forms, Cm and Dm. the 
time limit stipulated in the Manual of Direc- 
tions is thirty minutes. However, since the 
students’ scores were not to be compared with 
any norms set up by Otis, time limits of 15 
minutes (on the Cm) and 10 minutes (on the 
Dm) were set. An informal set of instruc- 
tions appropriate to the groups was substi- 
tuted for the standardized instructions. These 
instructions were, of course, identical for 
groups taking the tests in different rooms 
The method of marking the separate answer 
sheets was explained; the students were told 
to guess if they wished, but emphasis was 
placed on the statement that they should not 
waste time guessing‘; and the groups were 
informed that the individual results on the 
Otis tests would be kept confidential and 
would not go on their records or to their ad- 
visers. 

The tests making up the regular freshman 
battery were given after the practice tests and 
in this order: 

1. American Council on Education Psycho- 
logical Examination, 1949 College Edition, 
Linguistic Tests (ACE-L); and Quantitative 
Tests (ACE-Q). 

2. Cooperative English Test C2, Form S, 
Vocabulary (C2—-V); Speed of Reading Com- 
prehension (C2—S); and Level of Reading 
Comprehension (C2-L). 

3. Cooperative English Test A: Mechanics 
of Expression, Form T (Eng A). 

Each individual’s total scores and subscores 
on these three tests, expressed graphically 
as “normally” spaced percentile ranks based 
upon local norms, were furnished to the fresh- 


4 Test scores were corrected for “chance.” 
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Level 


Table 1 
Intercorrelations and Beta Weights Involved in the Prediction of First Quarter 
Grade Point Ratio from Freshman Tests 
(N = 136) 


0 1 
GPR 
1 Cm+Dm 48 wae 
2 ACE-L 44 
3° ACE-Q 
4 C2-V 
5 CLS 
6 C2-L 
7 EngaA 


Beta Weights 124 


man advisers as an aid in 


counseling. 


placement and 


Results 


Grade point ratios for one quarter and for 
three quarters were computed for the stu- 
dents who were included in the study.’ Ex- 
cluded from the one-quarter analysis were 
freshmen who carried less than eight quarter 
hours and from the three-quarter analysis 


were freshmen who carried less than 24 quar- 


A few students, who arrived late 
or who for other reasons were not present for 
the first administration of the tests, were 
given the tests later under less desirable con- 


ter hours. 


*GPR was computed, letting A + 
quarter hour, A= 11 points, A 

9 points, and so on down to D 
points 


12 points per 
10 points, B 4 
1 point, F=0 


2 
Cm+Dm ACE-L 


7 
Eng A 
62 : 67 . 67 
51 ; 70 
53 
60 
57 


51 


3 
ACE-Q 


032 — 427 413 


ditions, and it was felt that their test scores 
were perhaps not comparable with those of 
the original group. They too were omitted 
from the study. 

The correlations between the seven test 
scores and between those test scores and GPR 
for one quarter and for three quarters are 
shown in Tables | and 2 

Note that for the first quarter the correla- 
tion between Cm+ Dm and GPR exceeds all 
other correlations with GPR except that of 
Eng A; for three quarters, r between Cm + 
Dm and GPR exceeds the correlations of 
GPR with ACE-Q, C2-V, C2-S, and C2-L 
Among these validity coefficients, however, 
only the differences between Cm+ Dm and 
C2-V for one quarter and between Cm + Dm 
and ACE-Q for three quarters are significant 
beyond the one per cent level of confidence, 


Table 2 


Intercorrelations and Beta Weights Involved in the Prediction of Three-Quarter 
Grade Point Ratio from Freshman Tests 
(N = 119) 


0 1 
GPR Cm+Dm 
Cm+Dm 50 
ACE-L 51 
30 
45 
43 


Beta Weights 


.166 
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when the significance test for the difference 
between r’s with a common criterial array is 
applied.® 

The regression equations shown below do 
not meet the requirements of the most eco- 
nomical predictive equations.’ Rather, the 
beta weights were computed as a means of 
studying and comparing the contributions of 
the various tests to the prediction of GPR. 
The computation of the beta weights was car- 
ried out by a modified Doolittle method.* 

For one quarter fro.:234567 = .62,° and the 
predictive equation, using standard scores, is 


Zo = 1242, + 26522 + 03223 > 42724 
+ 1042; + .07525 + .4132;. 


1 refers to Cm+ Dm, 2 to ACE-L, 3 to ACE- 
Q, 4 to C2-V, 5 to C2-S, 6 to C2-L, and 7 
to Eng A. 

The largest beta weight is ‘that of the Vo- 
cabulary part of C2. (C2-V seems to serve 
as a “suppressor” variable. The hypothesis 
could be advanced that the abilities measured 
by this test are antithetical to those evaluated 
by the first-quarter freshman English course 
teachers at Peabody. Certainly no generality 
can be implied from this scant evidence, how- 
ever, especially when one compares this beta 
weight with the three-quarter beta weight of 
.064 (see Table 2) and considers “sampling 
fluctuations.” 

The various beta weights indicate the rela- 
tive contributions of the independent vari- 
ables to the prediction of GPR. Therefore, 
the contribution of Cm+ Dm is almost one- 
half that of ACE-L, is approximately four 
times that of ACE-Q, is about 11 times that 
of C2-S, is approximately 134 times that of 
C2-L, and is almost one-third that of Eng A. 

For three quarters, the multiple R between 
GPR and the seven test scores is .59. (This 
R corrected for shrinkage becomes .56.) The 
predictive equation, using the same notation 


®* McNemar (3, pp. 124-125). 
7 See, for example, Thorndike (4, pp. 201 f.). 

* Thorndike (4, pp. 335-339). 

® Fisher (1) and Wherry (5) have reported on the 
amount of bias in a multiple R when it is applied to 
a new sample and the correlation with a similar cri- 
terion computed. In such a situation we may antici- 
pate that the new R will be smaller than the original 
R. The multiple R of .62, corrected for such shrink- 
age, is 59. See Kelley’s (2) Formula 12:36, p. 474. 


Scarvia B. 


Anderson 


Table 3 


Intercorrelations and Beta Weights Involved in the 
Prediction of Three-Quarter Grade Point Ratio 
from Combined Scores on Freshman Tests 
(N = 119) 





0 I II III IV 
Cm+ ACE C2 Eng 
GPR Dm Total Total A 
ICm+Dm 50 . .68 65 
II ACE Total 48 
III C2 Total AT 
IV Eng A 55 








Beta Weights 





as above, is 


29 = 2422; + 01322 — 11523 + .0642,4 
-_ 08225 + 16626 + 36727. 


Here the contribution of Cm + Dm is about 
two-thirds that of Eng A and exceeds all other 
contributions. 

It is important to mention that “criterion 
contamination” may be present in the case of 
all of the predictors except Cm+Dm. The 
scores on Cm and Dm were the only test 
scores which were not made available to the 
teachers, and therefore they could have had 
no possible influence on the grading. Cm and 
Dm contributed substantially under fairly 
ideal conditions. 

In arriving at a third predictive equation, 
the scores on the tests were combined as 
shown in Table 3. 

The multiple R is .59 (.57, corrected for 
shrinkage). The regression equation becomes 


Zo = .2202, — 09024, + 712i + .3632,y. 


I refers to Cm+ Dn, II refers to ACE Total, 
III to C2 Total, and IV to Eng A. 

The use of Cm + Dm and Eng A in a fourth 
predictive equation, using again three-quar- 
ter GPR, indicates that the inclusion of Cm + 
Dm does not greatly enhance the original cor- 
relation between Eng A and GPR, though the 
multiple R, of course, represents a more 
stable measure. The multiple R is .57. The 
regression equation becomes 


Zo — 2122; + Al2z2ry, 
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where I refers to Cm+ Dm and IV refers to 
Eng A. 

It is interesting to note that in every case, 
Eng A is represented by the highest validity 
coefficient and the largest beta weight. The 
fact that English is a required course for 
freshmen at Peabody and mathematics is not 
may help explain the larger predictive value 
of some of the English tests, as compared with 
ACE-Q; but it does not contribute much to- 
ward an explanation of the differences be- 
tween Eng A and the other English tests. In 
considering other factors extrinsic to the test 
itself which might account for some of the 
high degree of relationship between Eng A 
and GPR, the fact that Eng A was adminis- 
tered last comes to mind. The time limit (40 
minutes) was adequate for far more than half 
of the testees to finish Eng A; the same was 
not true of any of the other tests. Perhaps 
in addition to knowledge of certain English 
fundamentals, Eng A tested, for this group, 
motivation and perseverance to a greater de- 
gree than any of the other tests. Perhaps, 
further, these qualities are closely related to 
freshman GPR at Peabody. 


Summary 


1. Two easy tests (Otis Quick-Scoring Men- 
tal Ability Tests, Beta Tests, for Grades 4-9, 
Forms Cm and Dm) were administered to a 
group of entering college freshmen for the 
purpose of giving the students practice on ob- 
jective tests and acquainting them with the 
mechanics of a machine-scored answer sheet. 
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2. These easy practice tests showed some 
predictive values above those of several more 
conventional placement tests; namely, Ameri- 
can Council on Education Psychological Ex- 
amination (1949 College Edition) and Co- 
operative English Test C2 (Form S). The 
usefulness of the inclusion of the Otis tests 
in such a battery is indicated. 

3. The Cooperative English Test A: Me- 
chanics of Expression (Form T), in every 
combination with the other placement tests, 
contributed most substantially to prediction 
of freshman GPR. 

4. The numerically largest beta weight in 
the one-quarter regression equation was that 
of C2-Vocabulary, which in this sample ap- 
peared to act as a “suppressor” variable. The 
corresponding beta weight in the three-quarter 
predictive equation was small but was posi- 
tive instead of negative. 


Received August 26, 1952 
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In a large organization, job assignment in- 
volves administration to potential employees 
of a wide variety of tests to predict proba- 
bility of success in different kinds of assign- 
ments. This is an expensive procedure, and 
most organizations which require continuous 
hiring have worked out means of spotting ap- 
plicants who have little chance to prove suc- 
cessful in any current job openings. One of 
these is the short preliminary test with cut-off 
scores based on empirically determined prob- 
abilities of meeting qualifying requirements 
for job appointment. 

This article describes a technique for con- 
structing a short test to determine probability 
of reaching a qualifying score on an aggregate 
score empirically weighted for prediction of 
suiccess in one group of training schools. The 
method was developed in connection with the 
Service problem of recruitment to meet man- 
power needs in a specialized job area. 


Method 


In the Air Force problem, the required short 
test is to predict probability of reaching a 
qualifying cut-off on a weighted aggregate 
score, the aptitude index. Each aptitude 
index combines the variables of the Airman 
Classification Battery for optimum  predic- 
tion of training success in one cluster of re- 
lated technical specialties. 

A preliminary form, twice the length speci- 
fied for the final predictor test, was composed 
of blocs of items, with each bloc patterned 
after one of the components of the aptitude 
index. Analysis of results from a try-out of 
the preliminary form determined selection of 
items for the final form. Test scores included 
in the aptitude index are converted to nor- 
malized standard AF scores before weighting 
them into the aggregate. Sections of the pre- 

‘The views expressed in this article are those of 
the authors and do not necessarily represent the offi- 
cial views of the United States Air Force. 


dictor test are weighted by the number of 
items so that the total raw score is appro- 
priately weighted. Table 1 shows the com- 
position of the criterion, and the preliminary 
and final forms of the predictor. 

Items in five of the six subtests were se- 
lected from appropriate item pools for sig- 
nificant discrimination against the correspond- 
ing test of the aptitude index. Experience 
items were selected and keyed for positive 
correlation with both the Biographical In- 
ventory score and the aptitude incex. Be- 
cause of the restricted choice of items for 
Subtest 6, a group of items in a related area, 
Test VII, was included in the preliminary 
form for possible use if the items of Subtest 6 
did not hold up in the analysis. 

The preliminary 64-item form was adminis- 
tered to two unselected samples which had 
about equal representation of men assigned 
for basic training to Sheppard and to Lack- 
land Air Force Bases. 

For analysis purposes, each sample of 370 
was split into the Sheppard group and the 
Lackland group. Table 2 shows the com- 
position of the samples and score distribution 
statistics for the preliminary test, the cri- 
terion, and a vocabulary test. 


Table 1 
Composition of the Criterion, the Preliminary Form, 


and the Final Form of the Predictor 


Predictor 


Criterion 


No. of Items 

No. of 
Items Weight 
35 
Il 143 
30 
30 
15 
30 
20 


Test Prelim. Final 


1 
1 


Nee NN 





A Short Test to Predict a Complex Aggregate Score 


Table 2 


Raw Score Distribution Statistics for the Preliminary Test and Standard AF Score Distribution 
Statistics for the Aptitude Index and a Vocabulary Test 


Preliminary 
Test 


SD 


Sample I 
Lackland 
Sheppard 

Sample IT 
Lackland 
Sheppard 


Correlation of 
Preliminary 
Test with 
Aptitude Index 


\ptitude 
Index 


Vocabulary 
Test 


M sD M SD 


Table 3 


Distribution Statistics and Correlations of the Predictor* with the Criterion 


Predictor 


M 
Sample I 

Lackland 194 19.5 
Sheppard 176 17.7 
Total 370 18.7 

Sample II 
Lackland 193 
Sheppard 177 
Total 370 


Sample ITT 
(Independent) 


19.4 
17.8 
18.6 


882 17.0 


Correlation of 
Predictor with 
Aptitude Index 


Aptitude Index 


M SD 


6.6 


* Scoring keys for the selected 30 items applied to answer sheets for the preliminary test. 


Selection of items for the final form was 
based on several criteria: (1) Correlation 
() with the aptitude index; (2) Correlation 
(()) with the parent test; (3) Lower discrimi- 
nation for other tests of the aptitude index 
composite than for the parent test; and (4) 
Difficulty index centering around 60% R (un- 
corrected). 

Effect of chance error was diminished by 
running the item statistics separately for the 
two samples. Instead of preparing separate 
30-item keys for each sample, the criterion of 
consistency between samples was added for 
producing a single 30-item key. 


Efficiency of Prediction 


Application of the 30-item key to the ex- 
perimental answer sheets yielded the distribu- 
tion statistics and correlations appearing in 


Table 3. 
I and II. 


The key was developed on Samples 
Sample III is independent. 

Since the new test is essentially a short 
form of the aptitude index, the predictor has 
a special relation to the criterion. The Kuder 
Richardson estimate of reliability (Formula 


Table 4 


Correlations with Control Aptitude Index 
(Sample: 324 Lackland Airmen 


Correlation 
with 
Control 
Aptitude 
Index 


Control Aptitude Index 
Criterion Aptitude Index 
Predictor Score 
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PROBABILITY OF MAKING AI ZS 





THE PROBABILITY TABLE 
PREDICT OR PERCENT MAKING 


SCORE ai z LJ 
27 AND OVER 100.0 
26 98.5 
25 100.0 
24 967 
23 100.0 
22 93.5 
2! 96.5 
20 65.2 
19 642 
(8 629 
17 71.6 
16 42.1 
1s 41.0 
14 20.4 
13 16.5 
‘2 13.6 
i 6 
10 63 
9 43 
@ AND BELOW 139 0.0 


TOTAL 1622 S04 








+ 2 3 4 8 @© FF 8 9 0 


‘6 6 I7 18 9 20 2) 22 23 24 26 26 27 26 29 30 


PREDICTOR TEST—RAW SCORE 


Fic. 1. 


Curve showing probability of making an aptitude index of 5 or more for each raw score on 


the predictor test. 


20) is .84. The estimate obtained by cor- 
relating scores for the final form against scores 
for the remaining 34 items is .82. These re- 
liability coefficients do not differ significantly 
from the coefficients of prediction (.84 — .87). 

To show that the predictor test is specifi- 
cally predictive of the criterion, the correla- 
tion was computed with a control aptitude 
index of median correlation with the criterion 
aptitude index and maximum correlation with 
the Armed Services Qualification Test. Table 
4 shows these correlations. 

Because of common components in the eight 
Air Force aptitude indexes, their intercorrela- 
tions are high. Consequently the correlation 
of the predictor with the control aptitude in- 
dex (.65) is less than the correlation between 
the criterion aptitude index and the control 
aptitude index (.77). 

Rather than a direct score conversion table, 
empirical probabilities for achieving an apti- 
tude index of at least 5 were computed from 
the combined sample of 1622 for each pre- 


dictor score directly from the 30 x 9 regres- 


sion chart. Figure 1 shows that the curve of 
percentages closely approximates the expected 
ogive. The steepness of the curve between 
predictor scores 16 and 17 suggests a reliable 
cut-off for a better-than-even chance of quali- 
fying for training in the specific job area. 


Summary 


This method of constructing short screening 
tests offers two advantages: 

1. The screening process can be readily di- 
rected to current: personnel requirements. 

2. A simple “Rights” score read into a table 
of probabilities makes it possible to use cleri- 
cal assistants with only a minimum of train- 
ing for administering, scoring, and interpret- 
ing the tests. 

The method is applicable only in conjunc- 
tion with reliable, well-validated selection in- 
struments. 


Received November 10, 1952. 
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The need for a more extensive knowledge 
of occupational interests is well recognized 
by vocational counselors. The empirical evi- 
dence is limited largely to the data concern- 
ing the Strong Vocational Interest Blank and 
the Kuder Preference Record. Since these 
inventories have been applied to only a small 
number of occupations, it is frequently nec- 
essary in practice to speculate about the na- 
ture of the interests for many occupations. 
An “unknown” occupation presents at least 
two problems: (1) What are the character- 
istic interests of this occupation?, and (2) In 
what known interest group does this occupa- 
tion belong? 

These problems are commonly approached 
by developing interest keys using Strong’s 
method or by securing Strong interest profiles 
for unknown occupations. Since these meth- 
ods present practical and financial problems, 
a simpler, less expensive method of measur- 
ing and classifying interests for a large num- 
ber of occupations would accelerate the ex- 
tension of our knowledge of interests and in- 
terest groups. 

This study is an attempt to classify occupa- 
tions empirically using KPR profiles and to 
present a research tool for validation. While 
the sets of interest groups developed here are 
empirical in nature, their predictive power. 
especially with respect to job satisfaction, is 
largely unknown. It is hoped that others will 
be able to test and extend this classification 
system by making cross-comparisons with the 
Strong, and by predicting job satisfaction or 
vocational choice. 


Method 


A group of 45 KPR profiles representing 
the major interest groups for men, as defined 
by the SVIB, was selected from the Kuder 
manual of instructions (4). This selection 
was made since the Strong groups represent 
a classification system supported by consider- 


able evidence including a number of factor 
analyses by Strong (6) and Thurstone (8). 
It is assumed that a new method of classifica- 
tion would reveal comparable interest groups. 

About 27 of the 45 occupations used in this 
sample are similar to, if not identical with, 
the Strong sample of 44 occupations. Eighteen 
additional Kuder profiles were used to define 
more accurately the limits of a given interest 
group, and to increase the representativeness 
of the group by employing a larger sample of 
occupations. This need is especially apparent 
in the case of groups defined by one to three 
occupations. 

A second group of 42 profiles was secured 
for women. No attempt was made to select 
these profiles in terms of occupational groups; 
however, apprentice and military occupations, 
except for aviation assembly and_ repair 
worker, were avoided. Also, housewives as 
an occupational group were not used since the 
Kuder sample is limited to only three groups 
of housewives (wives of lawyers, physicians, 
and farmers) and may accordingly be quite 
unrepresentative of housewives-in-general. 

For females, the Kuder sample contains 
about 17 of the 25 occupations in the present 
Strong Blank. The twenty-five additional oc- 
cupations again were used to define the limits 
and to increase the representativeness of the 
interest groups. 

Using rho as an index of profile similarity, 
the Kuder profiles were intercorrelated.' By 
grouping profiles which intercorrelate .70 or 
greater, a set of interest groups was derived 


1 Profiles were coded by listing the highest scale 
first with the remaining scales following in descend 
ing order. For these computations the outdoor scale 
was omitted since it was available for only a few 
occupations. The matrices formed by the intercor- 
relation of profiles (16 pages) are deposited with the 
American Documentation Institute. Order Document 
3725 from American Documentation Institute, Li 
brary of Congress, Washington 25, D. C., remitting 
$1.00 for microfilm (images 1 inch high on standard 
35 mm. motion picture film) or $2.40 for photecopies 
(6 X 8 inches) readable without optical aid. 
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for each sex. This procedure consisted of a 
simple cluster analysis. Each profile was in- 
spected for its pattern of intercorrelations. 
Occupational groups were formed by classify- 
ing profiles having similar intercorrelational 
patterns. In most cases the evidence for a 
particular grouping is clear-cut; however, 
when a profile correlates with about equal fre- 
quency with the occupations of two or more 
groups, it is listed in each group in order to 
give an accurate picture of the data. 

It seemed meaningful to make several ex- 
ceptions to this method of classification. In 
the case of males, the profiles for farmer, 
aviator, carpenter, and forest supervisor are 
placed in the interest group with which they 
show the highest single correlation. For fe- 
males, this relaxation of the criterion was 
made for stenographer and typist, and sales 
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clerk. Although these profiles fail to meet 
the criterion for inclusion, their intercorrela- 
tional patterns are similar to the typical pat- 
tern of their respective groups. 

In order to secure a useful arrangement of 
occupations within a given interest group, oc- 
cupations are ordered in terms of their “rep- 
resentativeness.”” The occupation which shows 
the greatest number of correlations equal to 
or greater than .70 with the other members of 
the same group is listed first in that group. 
This occupation is designated as the “core” 
occupation. The remaining occupations are 
then arranged in descending order of correla- 
tion with the core profile. Ties in rank were 
resolved by comparing the number of correla- 
tions equal to or greater than .70 for each of 
these occupations with the other occupations 
in the same group. The relative position of 


Table 1 


Kuder Interest Groups (Male) 


Group Occupation 


T. Skilled and Technical 
Asst. District Rangers 
Electricians 
Vocational Training Teachers 
Machinists 
Meteorologists** (2) 
Engineers (3) 
Draftsmen 
Aviators 
Farmers 
Carpenters 
II. Managerial 
Production Managers 
Engineers (3) 
Controllers 
Scientific 
Psychologists 
H. S. Teachers of Mathematics 
Laboratory Technicians 
All Physicians and Surgeons 


IIT. 


Chemists 
District Rangers 
Meteorologists (2) 
Protective Service Occupations 
Engineers (3) 
IV. Drugstore Managers and Pharmacists 


Rho 


Code* 


01325687794 
1°30528697'4 
153826974 
153279864’ 
3’6127589'4 
°3216547098’ 
5’13279684’ 
31’796528"4 
0’913825647’ 
1058973240’ 


*2631495807’ 
3216547098’ 
23'916475’8 24 


36’285791'4 111 
23'867519'4 30 
81 3’56278914’ 90 
78 3’65807 1294’ 260 
3’672518'49 54 
ae 0’ 256381749’ 102 
.68 3’6127589'4 185 
.66 6870351249’ 23 
43 73216547098’ 653 
342987561’ 140 


__* Scales to the left of the first apostrophe indicate scales at or above the 75th percentile. Scales to the right 

* of the last apostrophe are at the 25th percentile or below. 
** The number in parentheses following occupational title designates occupations listed in two or three interest 
groups / 





Occupation Classification by Kuder Interest Profiles 


Group 
V. Welfare 
H. S. Teachers of Social Studies 
School Administrators 
Social and Welfare Workers 
Forest Supervisors 
Clergymen 
VI. Clerical 

General Office Clerks 

General Accountants 

Office Mgrs. and Chief Clerks 

Cost Accountants 

Printers and Pressmen 

Financial Institution Clerks 

Lawyers and Judges (2) 

Purchasing Agents and Buyers (2) 

Expressive 
Sales Managers 
Life Insurance Salesmen 


Occupation 


VII. 


Salesmen, to Consumers 

Reg. Salespersons, Dept. Store 
Stock and Bond Salesmen 
Advertising Agents 

Route Salesmen 

Authors, Editors, and Reporters 
Personnel Managers 

Banking, Finance, and Insurance Officials 
Lawyers and Judges (2) 
Purchasing Agents and Buyers (2) 
Musicians and Music Teachers 
Commercial Artists 


an occupation within its group serves then as 
a crude index of its communality or belong- 
ingness. 

Each set of interest groups was arranged by 
inspecting the matrix formed by the core oc- 
cupations. The highest negative correlation 
between a pair of core occupations designates 
the first and last interest groups, or the groups 
whose interests are most divergent. The 
remaining groups are placed between these 
groups in accordance with their correlation 
with the first group listed.* 


Results 


Males. he classification of profiles pro- 
duced seven interest groups which have been 


2If the remaining groups are arranged in accord- 
ance with their correlation with the last group, 
groups V and VI will change position, but the origi- 
nal arrangement is essentially the same. 


Table 1—Continued 


Rho 


Code* 





8’6243795'1 
88 8’62934751’ 
83 8'6439257'1 
68 0’682543197’ 
63 86'793254'1 


9°267438501’ 
29°64730851’ 
2'964758301’ 
296475318’ 
976253418" 
2’98674351’ 
6'97428503' 1 
469278531’ 


4’768953201’ 

4’7869532'1 

4’678935012’ 

4’7965823’1 

4’8796523'1 

6475893712 

4’87569312’ 104 

6’794850'321 113 

”486792305'1 50 

’4796258031’ 42 

6’97428503'1 331 
: 469278531’ 103 
70 7°65894'321 77 
50 5’6794281'3 31 


designated tentatively as: I. Skilled and Tech- 
nical; II. Managerial; III. Scientific; IV. 
Drugstore Managers and Pharmacists; V. 
Welfare; VI. Clerical; and VII. Expressive. 
Table 1 shows the male sample classified into 
these groups. To increase the usefulness of 
Table 1, the rho with the core occupation, the 
N, and the code * for each occupation have 
been listed. 

In general, the obtained groups are similar 
to related Strong Groups; the Kuder Groups 
I, II, III, V, and VI agree in content with the 
Strong Groups IV, III, I, V, and VIII, respec- 
tively. The differences between comparable 
groups seem slight. 

8 The attention of readers is directed to the mis- 
leading character of a mechanical coding device for 
counseling purposes that isolates percentiles of 75 or 
greater or percentiles of 25 or lower. See Diamond, 


S. The interpretation of interest profiles. J. appl. 
Psychol., 1948, 32, 512-520.—Editor. 
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Table 2 


Kuder Interest Groups (Female) 


Group Occupation Rho 


I. Computational 
H. S. Teachers of Mathematics 2’31597864’ 
Office Machine Operators j 2713598740’ 
Tearoom and Restaurant Mgrs. a 2’3514697’8 
Hospital Dietitians** (2) ; 3’21765849” 
Statistical Clerks A: 2’36574189" 
II. Scientific and Technical 
H. S. Teachers of Home Economics 513867249’ 
Aviation Assembly & Repair Wrkrs. ; 135786249 
Cooks and Bakers : "16347582’9 
Physicians é 31’85627’49 
All Trained Nurses 8: 835176249’ 
Supervisors and Head Nurses : *831752649" 
Dental Hygienists : 83’571462’9 
Laboratory Technicians , 3175274869 
Occupational Therapists 6. 15’738624’9 
Home Demonstration Agents } 851473209 
Hospital Dietitians (2) A 3’21765849” 
II. Clerical 
H. S. Teachers of Commercial Subjects 2’94756138’ 
General Office Clerks 85 295471368’ 
Bookkeepers i 296754381’ 
Stenographers and Typists m? 973562148’ 
IV. Linguistic 
Journalists 6’5473182’9 
Copy Writers, Mail Order Co 64’57132’89 
Librarians 6’57 149328’ 
Artists and Art Teachers 5’167483’29 
H. S. Teachers of Language (2) 6’75489132’ 
H. S. Teachers of English (2) 6'75482193’ 
V. Expressive 
Assistant Buyers, Dept. Store 40'7852193’ 
Personne] Mgrs., Mail Order Co. 4 468751932’ 
H. S. Teachers of English (2) , 6'75482193’ 
H. S. Teachers of Social Studies } 684527193’ 
Social Workers ; 8'647531'29 
H. S. Teachers of Language (2) Be 6’75489132’ 
Personnel Wrkrs. other than Mgrs. “Ba 48’6217953’ 
Musicians and Music Teachers ; 7°5684192’3 
Cashiers ; 746529381’ 
Retail Buyers : 4’7625139’8 
Salespersons, Dept. Store, Reg. : 475896231’ 
Religious Workers F 8’6754139'2 
Floor and Section Mgrs., Dept. St. j 468297 135’ 
Secretaries é 467952138’ 
Executives, Mail Order Company 56 427653981’ 
Teachers, Primary and Kindergarten 50 857621493’ 544 
Office Mgrs., Chief Clerks 40 426179358’ 29 
Sales Clerks 38 849761325’ 26 
Telephone Operators .22 *495781236’ 22 


<= 
—_oumo ul 


sy sr ty Wy 


* Scales to the left of the first apostrophe indicate scales at or above the 75th percentile. Scales to the right 
of the last apostrophe are at the 25th percentile or below. 
** The number in parentheses following occupational title designates occupations listed in two or three interest 
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In the Kuder classification, engineers are 
classified in the skilled, scientific, and mana- 
gerial groups rather than in science alone as 
in the SVIB. District rangers are classified 
in both the skilled and scientific groups rather 
than in science alone. Protective service oc- 
cupations are classified in science rather than 
in skilled trades. Personnel managers are 
classified in the expressive group rather than 
social service. Lawyers are classified in the 
clerical and expressive groups rather than lan- 
guage occupations only. Printers and press- 
men are classified in the clerical group rather 
than in the skilled trades. Purchasing agents 
and buyers are classified in both the clerical 
and expressive groups rather than in business 
detail alone. Pharmacists and drugstore man- 
agers form a separate group in the Kuder 
data while they fall in Group VIII on the 
Strong. 

These differences are due in part to the 
classifying of occupations in one or more 
groups by the KPR, and to the limiting of 
an occupation to a single group by the SVIB. 
Consequently, only four of the above occupa- 
tions are placed in opposed interest groups: 
protective service occupations, personnel man- 
agers, printers and pressmen, and pharmacists 
and drugstore managers. 

The creation of Group VII, Expressive Oc- 
cupations, presents the greatest difference be- 
tween these interest systems. Group VII in- 
corporates Strong Groups IX and X and a 
number of other occupations: salesmen to 
consumers; regular salespersons (department 
store); stock and bond salesmen; route sales- 
men; personnel managers; banking, finance, 
insurance officials; purchasing agents and buy- 
ers; musicians and music teachers; and com- 
mercial artists. The cohesiveness of Group 
VII is marked. The first four occupations in- 
tercorrelate .70 or greater with each other. 
Furthermore, the median rho for the entire 
group of 14 occupations with the core occupa- 
tion, sales manager, is .86. 

While it is possible to fractionate Group 
VII into three sub-groups consisting of sales, 
language, and art (including music), there 
is no empirical justification for such groups 
since the correlational patterns show no sharp 


differences. This procedure would, of course, 
make the two interest systems appear more 
alike. 

Females. The correlational matrix for fe- 
males produced five interest groups: I. Com- 
putational; II. Scientific and Technical; III. 
Clerical; IV. Linguistic; and V. Expressive. 
The comparability of these groups with the 
13 groups shown by Strong (7) is difficult to 
ascertain. The Strong groups are defined fre- 
quently by a single occupation so that their 
limits are not clearly structured. 

Kuder Group I, Computational, includes 
Strong Group XII (mathematics and science 
teacher) and three additional occupations not 
found in the Strong sample: office machine 
operators, tearoom and restaurant managers, 
and statistical clerks. Hospital dietitian in 
Strong Group IX falls in this group and also 
in Group II, Scientific and Technical. 

Kuder Group II, Scientific and Technical, 
includes Strong Groups IX, XI, and XIII 
(home economics teacher, dietitian, occupa- 
tional therapist, nurse, laboratory technician, 
and physician) as well as a number of occu- 
pations not contained in the SVIB. 

Kuder Group III, Clerical, is a rough ap- 
proximation of Strong Group VII as both 
groups include high school teachers of com- 
mercial subjects, general office workers, book- 
keepers, and stenographers. 

Kuder Group IV, Linguistic, combines 
Strong Groups I and IT (artist, librarian, and 
English teacher) and a number of language 
occupations not included in the SVIB. 

Kuder Group V, Expressive, combines 
Strong Groups III, IV, VI and VIII (so- 
cial worker, social science teacher, elementary 
school teacher, and buyer) as well as a num- 
ber of related sales, social service, and ad- 
ministrative occupations. High school teach- 
ers of English which occur in Kuder Group 
IV are also listed in Group V. 

In general, the Kuder set of interest groups 
appears to be a coarser classification system 
than the Strong set, but the direction of their 
classification appears essentially the same. A 
more accurate picture of the relationships be- 
tween these systems can be obtained by a 
comparison of their correlational matrices 





268 


Discussion 


The occupational classification system pre- 
sented here is limited by the original data. 
The representativeness of most of the occu- 
pational profiles is largely unknown; fur- 
thermore, each criterion group contains both 
successful and unsuccessful, experienced and 
inexperienced, as well as satisfied and dis- 
satisfied workers (4). The usefulness of this 
interest system in interpreting individual pro- 
files is consequently restricted. 

The validity of these interest groups is 
problematical. Tests of significance are in- 
appropriate because of the large number of 
computations and because of the unorthodox 
use of rho; that is, varying N’s and yet only 
eight degrees of freedom for each correlation. 
The use of rho as an index of profile simi- 
larity violates the assumptions underlying its 
application. Moreover, as Guilford (3) points 
out, the “ipsative property of the Kuder 
scores . . . renders their use for intercorrela- 
tions among themselves . . . so questionable 
as to preclude attempts at analysis by the R- 
technique.” 

These difficulties pose a choice of abandon- 
ing the evidence until more adequate data can 
be obtained and statistical elegance can be 
achieved, or to test the interest groups by 
means of a prediction study. The latter al- 
ternative seems desirable in view of the need 
for an immediate understanding of the present 
data. Although a predictive test may make 
statisticians wince, it will yield an estimate of 
the predictive power of the classification. 

While they furnish only suggestive and in- 
complete evidence, several related studies sup- 
port the Kuder interest groups. In a factor 
analysis of the SVIB, KPR, Bell Inventory, 
and MMPI, Cottle (2) extracted seven fac- 
tors similar to those described by Thurstone 
(8) and Strong (6). Cottle’s interest fac- 
tors support the Kuder classification includ- 
ing Group VII, Expressive, which combines 
Strong Groups IX and X in addition to a 
number of other occupations. The factor G 
obtained by Cottle appears similar to the 
Kuder Group VII since it is characterized by 
high positive loadings on Strong Groups IX 
and X and high negative loadings on the 
Kuder mechanical scale. Similarly, an in- 
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spection of the present Kuder matrix indi- 
cates that the expressive occupations correlate 
most negatively with the skilled trade occu- 
pations. 

In addition, Cottle’s matrix for the SVIB 
with the KPR reveals that the Strong Group 
keys correlate with the KPR scales in a pat- 
tern which is similar to the coded profile for 
the comparable Kuder interest group. The 
positive and negative correlations of Kuder 
scales with a given Strong group scale produce 
coded profiles which are similar to those in 
the Kuder Groups. For example, the code 
for high school teachers of social studies, the 
core occupation for Kuder Group V, Welfare, 
is 862437951. Cottle’s matrix produces the 
code 867495213. The other five group scales 
show similar relationships with the Kuder in- 
terest groups. 

In a study of occupational test patterns, 
Barnette (1) has supplied Kuder profiles for 
“success” and “failure” samples for five oc- 
cupational groups: engineers, accountants, 
clerical personnel (except accountants), a spe- 
cialized clerical group (primarily verbal in 
nature), and salesmen. When the pairs of 
“success” and “failure” profiles are correlated 
with comparable Kuder core occupations, six 
of the seven tests reveal that the “success” 
groups correlate higher with the core occupa- 
tion than do the “failure” groups. The data 


Table 3 


The Relation of Occupational Success and Failure 
to Core Occupations of Corresponding 
Kuder Interest Groups* 


Iii VI VII 
83  .66 44 
59 .21 —.09 





Occupations N I II 





Engineers 
Accountants 
Clerical 


(Specialized) 


Clerical 
(General) 


Salesmen 


mA MAHA MH WH BMH 


* Correlations are rho coefficients. 
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suggest that the degree of similarity of an in- 
dividual profile to a given interest group is 
related to success or failure in the occupation. 
Table 3 shows these relationships. 

The classification of occupations by means 
of the entire profile appears to have several 
advantages which other systems such as the 
method proposed by Weiner (12) lack. Sys- 
tems of classification which rely on the two 
or three highest scales, or the scales above a 
certain cutting score, utilize only a portion of 
the data. There is no experimental evidence 
revealing that “high” scores are more signifi- 
cant or useful than “low” scores. In practice, 
a coding system which uses both low and high 
scores impels the counselor to notice and use 
more of the data. Finally, a total code mini- 
mizes the misclassification of occupations. If 
only the high scures are used to categorize an 
occupation, occupations which have similar 
patterns may be sorted into different groups 
by means of one or two scales which may rep- 
resent the only differences between a pair of 
profiles. 

The results suggest further that previous 
studies of the SVIB and KPR (5, 9, 10, 11, 
13) may be in error in concluding that these 
instruments show little relationship. Their 
findings may be largely negative due to an 
inappropriate level of analysis; that is, a 
single scale comparison rather than a pattern 
method. 


Summary 


A sample of KPR profiles was intercorre- 
lated and classified by means of a simple 
cluster analysis. Sets of occupational groups 
for men and women were derived which are 
comparable with many of the SVIB groups. 
While these groups are empirical in nature, 
their validity is unknown. It was suggested 
that validation might be established by pre- 
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diction studies of job satisfaction and voca- 
tional choice. 
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The Problem Check List is an instrument 
developed by Mooney (1) to enable the 
teacher or counselor to quickly identify prob- 
lems or problem areas which concern his stu- 
dents. The high school form, which was used 
in this study, consists of 330 problems found 
to be of particular concern to students. They 
are classified into the following eleven major 
areas: (1) Health and Physical Development ; 
(2) Finances, Living Conditions, and Employ- 
ment; (3) Social and Recreational Activities; 
(4) Courtship, Sex, and Marriage; (5) So- 
cial-Psychological Relations; (6) Personal- 
Psychological Relations; (7) Morals and Re- 
ligion; (8) Home and Family; (9) The 
Future: Vocational and Educational; (10) 
Adjustment to School Work; and (11) Cur- 
riculum and Teaching Procedures. 

Normally the subject is instructed to un- 
derline those problems that bother him and 
to circle those underlined problems which 
trouble him the most. In this study no dis- 
tinction was made between underlined and 
circled items. 

Mooney (2) has said that the nature of the 
Check List makes it impossible to arrive at a 
definitive conclusion about its validity. Va- 
lidity, he says, must be determined in terms 
of the particular purpose and the particular 
situation. While it probably is true that con- 
ventional measures of validity are difficult if 
not impossible to obtain for an instrument of 
this kind, it appears nevertheless that the 
Check List should meet at least three mini- 
mum requirements: (1) Students recognize 
their own problems; (2) They find these 
problems listed on the Check List; and (3) 
They are willing to record them. 

This study assumes that if these three con- 
ditions are met it should be possible to pre- 
dict the relative number of problems listed by 
particular groups of students in particular 


* This paper represents the substance of a thesis 
submitted in partial fulfillment of the requirements 
for the M.S. degree at The Pennsylvania State Col- 
lege 


areas. Hence the following hypotheses were 
formulated: (1) The less intelligent students 
would have more problems than the more in- 
telligent in the area of Adjustment to School 
Work; (2) Seniors would have more prob- 
lems than those in the lower grades in the 
area of The Future: Vocational and Educa- 
tional; (3) Students from broken homes 
would have more problems than those from 
intact homes in the area of Home and Family; 
(4) Boys would have more problems than 
girls in the area of Adjustment to School 
Work; (5) Boys would have more problems 
than girls in the area of The Future: Voca- 
tional and Educational; (6) Negroes would 
have more problems than whites in the area 
of Finances, Living Conditions, and Employ- 
ment; and (7) Girls would have more prob- 
lems than boys in the area of Courtship, Sex, 
and Marriage. 

The rationale behind each of the hypothe- 
ses should be evident. 


Procedure 


Subjects. The subjects were 407 high 
school students in grades ten to twelve in- 
clusive. The school which they attended was 
the only public high school in a highly indus- 
trial Pennsylvania city with a population of 
approximately sixty thousand. The city popu- 
lation is highly heterogeneous in terms of 
race, religion and national origins, and this 
heterogeneity is reflected in the school popu- 
lation. 

Method. Approximately one-fourth of the 
school population was sampled. The Check 
Lists were administered by the homeroom 
teachers during the period prior to the first 
class in the morning. Homerooms were se- 
lected so that the proportion of students in 
the several courses and classes in the sample 
would approximate the proportion of students 
in these courses and classes in the entire 
school population. In this way it was possible 
to secure a reasonably representative sample 
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Table 1 


Groups and Problem Areas Relevant to Hypotheses 1 to 6 with N, Mean, SD and CR for Each 


Hypot hesis 


1 Adjustment to School Work 


Problem Area Mean SD 


.28 
12 


Group N 


Less intelligent 55 


More intelligent 


The Future: Seniors 07 


04 


Vocational and Educational Sophomores 


Broken Home 
Intact Home 


Home and Family 10 


02 


Adjustment to School Work Boys 


Girls 


07 
05 
The Future Boys 
Girls 


O05 
04 


Vocational and Educational 


Finances, Living Conditions Negro 


White 


08 


and Employment 


while retaining the administrative convenience 
of intact homerooms. 

In questionnaires of this kind the problem 
of a student’s honesty is a serious one, par- 
ticularly when there is a chance, as here, that 
his teachers may check his responses. As an 
example Olson (3), using the Woodworth- 
Mathews Personal Data Sheet, found that 
more symptoms were reported when the ques- 
tionnaire was left unsigned. Therefore ia this 
study a supplementary instruction sheet was 
attached to the Check List explaining that 
the study was being conducted to gather in- 
formation on the problems of high school stu- 
dents and instructing them not to sign the 
Check List. They were, however, to put their 
names on the instruction sheet and hand this 
in for an attendance record. A system of 
discrete pinholes pricked through both the in- 
struction sheet and the Check List made it 
possible to later match the two and identify 
the Check List. 

Information on the relevant variables was 
abstracted from the students’ records in the 
school file. Only two of these variables re- 
quire further definition: (1) “Less intelligent 
students” are defined in this study as those 
students whose Otis Gamma IQ’s were more 
than one standard deviation below the mean 
IQ of the sample. “More intelligent students” 
are those whose IQ’s were more than one 
standard deviation above the mean of the 
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sample; and (2) A student was classified as 
coming from a broken home if the records 
indicated that he was not presently living with 
both natural parents. 

Treatment of the Data. Vhe mean num- 
ber of problems reported was computed for 
each of the variables and problem areas which 
was relevant with respect to the hypotheses. 
The hypotheses were tested by computing the 
critical ratio of the difference between these 
means. 

Results 


1. Hypotheses 1 and 2 were confirmed. In 
Table 1 it will be seen that the differences be- 
tween the mean number of problems reported 
in each case were significant at or beyond the 
.01 level of confidence. 

2. Hypotheses 3, 4, 5, and 6 were con- 
firmed. In Table 1 it will be seen that the 
differences between means were significant at 
the .05 level of confidence. 

3. Hypothesis 7 was not confirmed. No sta- 
tistical difference between means was found. 


Summary and Conclusions 


The problem of determining the validity of 
the high school form of the Mooney Problem 
Check List was attacked by computing the 
mean number of problems checked in par 
ticular problem areas by a group of high 
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school students who were classifiable into 
various discrete groups. 

This study was founded upon the assump- 
tion that the essential test of the validity of 
an instrument of this kind consists in deter- 
mining whether or not the students can recog- 
nize their own problems, find these problems 
represented on the Check List, and record 
them. If these three criteria are met the 
mean number of problems checked in par- 
ticular areas by various groups should differ 
significantly in a reasonable and predictable 
way. 

Hence, seven such differences were hy- 
pothesized on rational grounds. That is, be- 


cause of the sociological and psychological 
characteristics of particular groups, it was 
predicted that some groups would check more 
problems in certain areas than other groups, 
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providing the three criteria of validity speci- 
fied above were met by the Check List. Of 
the seven differences hypothesized, six were 
found. 

It is concluded that these findings present 
prima facie evidence for the validity of the 
Check List. 
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Various investigators have suggested that 
the distributions of scores of college students 
on certain of the MMPI scales are different 
from those reported in the manual of direc- 
tions. For instance, McKinley (2) reported 
that college students obtained higher K-scores 
than did a less selected (intellectually and 
educationally) population. Similarly, college 
men have been found to score high on the 
masculinity-femininity scale (3), indicating a 
“deviation of the basic interest pattern in the 
direction of the opposite sex” (1, p. 5). The 
MMPI has been extensively used in research 
and clinical investigations at the college level, 
so that it should be of interest to know some- 
thing of the extent to which T-scores obtained 
from the standardization group correspond to 
those based upon a college population. 

The MMPI (Booklet—short form) was ad- 
ministered to nearly one thousand juniors, 
seniors and first-year graduate students in 
education courses in the School of Education 
at the University of California, either in Edu- 
cation 110 (Educational Psychology) or in 
those courses required in the programs lead- 
ing to the General Elementary and General 


Secondary Teaching Credentials. T-scores 
were computed for each of the nine clinical 
scales ' for men (N = 470) and women (N 
571) separately. These samples are consid- 
erably larger (about 60 and 40 per cent re- 
spectively) than those of the original stand- 
ardization groups. It is recognized that these 
norms might not be representative of the gen- 
eral college population, since the majority of 
the subjects were expecting to enter the teach- 
ing profession. However, the college norms 
to be discussed here may be of interest to 
those who are administering this Inventory to 
college students, and especially to those con- 
cerned with personnel problems in a teacher 
education program. 

It is the purpose of this note to present a 
brief comparison between the norms reported 
by Hathaway and McKinley (1) and by 
Tyler and Michaelis (6). Comparative data 
are presented in Table 1 for women and Ta- 
ble 2 for men. 

For the women, there seem to be some dif- 
ferences between the norms on three scales, 


1 The scores were not corrected by means of the 
K-score (2, 7). 


Table 1 


Raw Score Equivalents of Selected Standard Score Values Based on Manual and 


U. C. Norms for 


Female Subjects 


Standard Scores 


60 
Ct 
14 
33 
34 
26 
24 
17 
30 
28 
27 


M 
17 
29 
30 
22 
27 
15 
28 
27 
23 


. 

11 
29 
30 
22 
29 
14 
24 
21 
23 


Scales 
Hs 
D 
Hy 
Pd 
Mf 
Pa 
Pt 
Sc 
Ma 


19 
19 


50 

C 
7 
24 
26 
18 
33 
12 
17 
15 
19 


M 


— 


‘ 


* Raw score equivalents based on norms in the Manual (1). 
t Raw score equivalents based on college norms (6). 
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Table 2 


Raw Score Equivalents of Selected Standard Score Values Based on Manual and 
U. C. Norms for Male Subjects 


, Standard Scores 


60 


C 


M 

9 
21 
22 
18 


11 
17 
17 
18 


* See footnote to Table 1 


Hs, Pt and Sc. Using the manual norms as 
the basis for interpretation, it is suggested 
that the college women were less concerned 
about their health, were freer from fears and 
lack of confidence, and from bizarre or un- 
usual thoughts (1, 4). On the remainder of 
the scales there was a high degree of similarity 
between the norms obtained from the two 
samples. 

Several comments about the two sets of 
norms are in order: 

1. The college men obtained relatively lower 
scores than did the standardization sample on 


90 


50 


M C 


4 4 
17 18 
16 20 
14 15 
20 

8 


40 
M 
0 


11 
10 


9 
14 


only one scale, Hs. Accepting the usual in- 
terpretations of this scale, it appears that the 
college men were less concerned than were 
these members of the standardization group 
about the state of their health. 

2. The college men appeared to be some- 
what less depressed and more feminine in 
their interests when compared with the mem- 
bers of the original standardization group. 
For instance, on the D scale, a raw score of 
29 has a T-score equivalent of 80 on the 
manual norms and of 71 on the college norms. 
Similarly on the Mf scale, a raw score of 30 





Manual Norms ~ 
~% 


““—~ college Norms 


T-scores 





L i 


50 


— —o— ——_ —o— ——_ —o— — —o— — 


1 i L i 











Hs Hy Pd 


Mf 


Pa Pt Se Ma 


MMPI Scale 


Fic. 1. 


T-scores on the Manual norms of raw scores corresponding to T-scores of 70 on 


the College norms (Men). 





A Comparison of Manual and College Norms for the MMPI 





WOMEN 


College Norms 





Manual Norms 





50 4 i 


2? — 


i, —<_~ 


i i i i 











Hs Hy Pd 


Mf Pa Pt Sc Moa 


MMPI Scale 


Fic. 2. 


'-scores on the Manual norms of raw scores corresponding to T-scores of 70 on 


the College norms (Women) 


has T-values of 69 and 55 on the manual and 
college norms respectively. 

3. Raw scores on the remaining scales had 
very similar T-values on both sets of norms, 
especially at that part of the scale, the upper 
end, which is claimed to have clinical signifi- 
cance. 

Another method of comparing the two sets 
of norms was suggested. Raw scores corre- 
sponding to T-scores of 70 on the college 
norms were selected as a basis of comparison. 
The T-score equivalents on the manual norms 
were obtained for these same raw scores and 
are graphed in Figures 1 and 2. A raw score 
of 70 was chosen because Hathaway and Mc 
Kinley consider it to be “a borderline score, 
although useful interpretation will always de- 
pend upon the clinician's experience with a 
given group” (1, p. 8). 

At the upper ends of the scales, it is ap- 
parent that discrepancies between college and 
manual norms are found on the Hs, D and 
Mf scales for men, and on Hs, Pt and Sc for 
women. 

In general, the differences between the two 
sets of norms appear to be relatively minor. 


However, multivariate analysis by means of 
Hotelling’s T (5) might reveal significant dif- 
ferences between the standardization and col- 
lege groups. 
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A previous article (6) reported on the non- 
cultural and cultural test scores of 213 pairs 
of white and Negro high school seniors who 
had been matched for age, school attendance, 
school curriculum, and eleven selected socio- 
economic factors. All subjects were between 
the ages of sixteen and twenty; the mean age 
for the whites was 18.1, and the mean age for 
the Negroes was 18.2. The subjects were ob- 
tained from schools in southeastern Pennsyl- 
vania and northern New Jersey. 

Socio-economic status was defined in terms 
of the score obtained on a revision of the Sims 
Record Card. The high Negro socio-economic 
group is composed of those Negro subjects 
whose revised Sims scores were in the highest 
25% of the range of Negro Sims scores. The 
low Negro socio-economic group is composed 
of those Negro subjects whose revised Sims 
scores were in the lowest 25% of the range of 
Negro Sims scores. 

Test questions were defined as non-cultural 
and cultural according to the pooled judg- 
ments of 78 school teachers, psychologists, 
and sociologists. Non-cultural questions are 
those which the judges considered least cul- 
turally-weighted; cultural questions are those 
considered heavily weighted with cultural ex- 
periences. 

Complete details on the selection and match- 
ing of subjects, the revision of the Sims Rec- 
ord Card and the determination of socio-eco- 
nomic status, and the dichotomizing of the 
questions can be found in the previous article 
(6). 

This paper is concerned with the problem 
of how the socio-economic status of Negro 
subjects affects their differential test perform- 
ance on non-culturally-weighted and cultur- 
ally-weighted test questions. 


Results 


Table 1 shows the mean non-cultural and 
cultural scores of the high and low socio-eco- 


nomic groups. Since the standard deviations 
of the non-cultural and cultural scores are al- 
most identical (4.62 for the non-cultural and 
4.64 for the cultural) the findings will be pre- 
sented in terms of raw scores. 

The difference in mean non-cultural score 
that is associated with a difference in socio- 
economic level (the H — L difference) is 2.22; 
the H —L difference for the cultural questions 
is 1.21. Thus, in the comparison between the 


Table 1 


Negro Non-cultural and Cultural Mean Raw 
Scores by Socio-economic Groups 


Socio-economic 
Group* 


High 


13.62 
9.81 


Type of 
Question 


Difference 
(H-L) 


2.22 
1.21 


Low 


11.40 
8.60 





Non-cultural 
Cultural 


Net change 1.01 
SE of net change 0.89 
t 1.24 
4 20% approx. 





* N for each group = 53. 


highest and lowest socio-economic group of 
Negroes, a greater difference is obtained on 
the non-cultural, not on the cultural, ques- 
tions. The difference between the two H — L 
differences is significant only at the 20% 
level. 


Discussion 


In his study of the effects of length of resi- 
dence in New York City on Negro test scores, 
Klineberg found that, as the length of resi- 
dence increased, test scores increased. He 
also found that his results “. . . are much 
clearer for the linguistic tests than for the 
performance tests” (5, p. 44). 

Various writers have described linguistic or 
verbal tests as sensitive to differences in socio- 
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economic status because of the culturally- 
weighted content of such tests (2, 3, 4). 
Others have described performance or non- 
verbal tests as not being as sensitive to socio- 
economic level because the content of these 
tests is not so culturally-weighted (1, 3, 5). 
Hence, Klineberg’s findings have been inter- 
preted to mean that increasing the socio-eco- 
nomic status of the Negro should be ac- 
companied by a greater improvement on cul- 
turally-weighted material than on the less 
culturally-weighted material. 

The present findings do not support such 
an interpretation. The present data show 
that the test superiority of the Negro of high 
socio-economic status over the Negro of low 
socio-economic status is associated more with 
a superior performance on the non-cultural 
questions than on the cultural questions. 


Received October 6, 1952. 
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Personnel Research Section, Personnel Research and Procedures Branch, TAGO, 
Department of the Army, Washington, D. C 


The Personnel Research Section, Personnel 
Research and Procedures Branch, TAGO has 
been conducting a series of studies aimed at 
identifying personal characteristics of raters 
which are associated with more valid ratings. 
The problem is of particular significance to 
this office which is responsible for the devel- 
opment of efficiency reports for Army-wide 
use. It is also important because the absence 
of more objective criteria makes it necessary 
to use multiple ratings in the validation of 
other types of instruments. If personal char- 
acteristics of the rater which are related to 
the validity of ratings he gives could be found, 
it might be possible to control them, perhaps 
in the selection of raters, or in the form of a 
“correction score.” While this may not be 
feasible on official efficiency ratings, it could 
profitably be done when obtaining ratings for 
use as criteria. Further, it may be possible to 
develop new techniques which would be more 
independent of the personal characteristics of 
the rater. 

Problem 


The study reported here was concerned with 
the validity of ratings by raters differing in 
three characteristics: aptitude test score, aca- 
demic achievement, and rated over-all value 
to the Army. 

Method 


Subjects. The population consisted of 400 
officers (primarily majors and lieutenant colo- 
nels) enrolled as students at the Army Com- 
mand and General Staff College. The objec- 
tive of this college is to train potential divi- 
sion commanders and general staff officers, 
and its students represent a highly selected 
group. The course was 42 weeks long and 

1The authors wish to acknowledge the assistance 
of various members of the staff, particularly Dr. E. A. 
Rundquist, Mr. A. H. Birnbaum, and Mr. Joel T. 
Campbell. The opinions expressed in this paper are 
those of the authors and do not necessarily reflect 
those of the Department of the Army. 


the students were in close contact with each 
other during the entire period. 

The officers were assembled in groups of 
33-40, the size of the classes, and asked to 
rate their class associates. In this manner 
each officer served as both rater and ratee. 

Design of the Study. This report covers 
one aspect of a larger research program on 
rating methodology. Only those aspects of 
the design pertinent to the present study will 
be presented here. 

The Criterion. The criterion measure was 
an appraisal of over-all value to the Army. 
The total population was randomly split into 
two groups, A and B, each consisting of 200 
officers. Officers in Group A provided the 
criterion rankings for all officers in the popu- 
lation. Each member of this group was re- 
quired to evaluate his class associates by plac- 
ing them in the highest, middle, or lowest 
third of the class. Each rater evaluated 20 
ratees from Group A and 20 ratees from 
Group B; thus each member of the total popu- 
lation was evaluated by 20 raters. The cri- 
terion score was the mean of the 20 rankings. 

Anonymous Rating Scale. This was an 8- 
point rating scale on which the officers were 
rated on over-all value to the Army. Each 
of the scale units was described in some de- 
tail. Group A completed 20 such ratings, 10 
on officers in Group A, and 10 on officers in 
Group B. Each of the 400 officers thus re- 
ceived 10 ratings with this instrument, and 
the mean of these ratings was used as the 
score. The raters were informed that these 
were to be held in confidence, that the rat- 
ings would not be made available to the Col- 
lege or the Army, and that the raters need not 
sign their names. These ratings will be re- 
ferred to hereafter as the unsigned ratings. 

Identified Official Rating Scale. This was 
the same 8-point rating scale just described. 
It was used by Group B, each officer rating 
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10 ratees from Group A and 10 ratees from 
Group B. Each of the 400 officers thus re- 
ceived 10 such ratings, and the mean rating 
served as his score. The raters were informed 
that these ratings would be available for offi- 
cial use for one year, and they were required 
to sign the ratings. These ratings will be re- 
ferred to hereafter as the signed ratings 

Forced Choice Pairs. The forced choice 
technique has been used in Army officer effi- 
ciency reports from July 1947 to September 
1950. Its use in efficiency reports was dis- 
continued largely because the form of forced 
choice used was not acceptable. For an ex- 
tended discussion, see Baier.” Research has 
continued, nevertheless, with the objective of 
developing more acceptable forms. One of 
these forms contained the grouping of phrases 
in pairs instead of tetrads as formerly used. 
The phrases used were taken directly from 
the former Efficiency Report, Form 67-1. 
Twenty-four pairs were employed in_ this 
study, members of each apparently equally 
favorable, but differing in their ability to dis- 
criminate better from poor officers as deter- 
mined by their criterion scores. The rater 
checked the phrase of each pair which he felt 
was More Descriptive of the ratee. Scoring 
was based on the discrimination values of the 
phrases checked. One such rating form was 
completed for each officer in the population 
by the raters of Group B. 

Controlled Check List. The controlled 
check list was the second form of the forced 
choice technique included in this study. The 
phrases used in the 24 forced choice pairs 
were grouped into two sets of 24 phrases each. 
The rater selected the 12 phrases of each set 
which he felt were most descriptive of the 
ratee and scoring was based on the discrimi- 
nation values of the phrases checked. One 
controlled check list was rendered on each 
officer in the population by the raters of 
Group A. 

Rater Variables. Raters were divided into 
equal thirds, highest, middle, and lowest, on 
the basis of scores on each of the variables 
described below. 


2 Baier, D. E. Reply to Travers’ “A critical re- 
view of the validity and rationale of the forced 
choice. technique.” Psychol. Bull., 1951, 48. 421-434 
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Aptitude. Scores on the Officer Classifica- 
tion Test (OCT), a high level aptitude test, 
were available for all officers. 

Final Class Standing. Officer students are 
ranked on academic work periodically during 
their attendance. The last ranking is the 
Final Class Standing (FCS). Prior to this 
study, class standing and the other variables 
were transferred to IBM cards in such man- 
ner that the identification of individual offi- 
cers was no longer possible. 

Derived Final Class Standing. ‘To remove 
the contribution of aptitude from Final Class 
Standing, predicted FCS was obtained from 
the regression of FCS on OCT. The differ- 
ence between actual and predicted FCS of 
each officer was used as another measure of 
achievement referred to here as the Derived 
Final Class Standing (Derived FCS). 

Over-all Value. This score was the mean 
of the 20 criterion rankings received by each 
rater. 

After the raters were divided into thirds, 
the validity of ratings by each of these thirds 
on each of the rating variables was obtained. 
For the 8-point scales, multiple ratings per 
ratee were available and validities were ob- 
tained for both single ratings and mean of 
ratings given by each rater. For the two 
forced choice forms, validities were obtained 
for single ratings only. 


Results 


The validities of ratings given by raters of 
each of the levels of rater characteristics 
studied are presented in Table 1. 

In general, a direct relationship existed be 
tween the validity of the ratings given and 
measures of the raters’ over-all value, apti- 
tude, and achievement. Except in a few in- 
stances, validity coefficients for the highest 
thirds were higher than those for the middle 
thirds and those for the middle thirds were 
higher than the validity coefficients for the 
lowest thirds. In no case did ratings by raters 
in the lowest thirds have higher validities than 
ratings by raters in the highest thirds. 

It will be noted that although the validities 
of ratings with the 8-point scale were slightly 
higher than those with the other types of rat- 
ings, the lower validity by poorer officers was 
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Table 1 








Unsigned 
8-Point Rating 


Raters Divided 
into Highest, 
Middle, and 

Lowest Thirds on 


Mean 
Ratings 
74 
ai 
.69 


Single 
Ratings 
Aptitude 
(OCT) 


Final Class 
Standing 
(FCS) 


74 
71 
60 


74 
75 
64 


Derived Final 
Class Standing 
(Derived FCS) 


79 
.66 
66 


Criterion 
Ranking 


present in all types of scales. Of the two 8- 
point rating scales, the validities were some- 
what higher for the unsigned than for the 
signed. However, Group A, which rendered 
the unsigned ratings, also performed the cri- 
terion ranking, so some degree of rater con- 
tamination may be present. 

Both forced choice forms had greater de- 
creases in validity from the highest third to 
the middle third of the rater groups than did 
the 8-point scales. There were three decreases 
as large as .19 for the forced choice forms, 
and the only comparably large decrease for 
the 8-point scales was .13. It thus appeared 
that raters of lesser ability, as defined in this 
study, produced more accurate ratings with 
the conventional technique than with forced 
choice or controlled check lists. 


Summary 


Officers at the Army Command and Gen- 
eral Staff College rated each other using four 


Validity of Ratings by Raters of Different Levels of Ability and Achievement 


Validity of Ratings on A 
Signed 
8-Point Rating 


(ontrolled 
Check List 


Forced 
Choice Pairs 
Single 
Ratings 

45 

43 

44 


Single Mean 
Ratings Ratings 
de 
.66 
00 


Single 
Ratings 
46 
48 
30 


50 
B) 
48 
54 50 
31 
40 


50 
46 
37 
72 
61 
62 


49 
36 
35 


55 


42 


.69 
66 
65 


49 
30 


48 
48 
31 





techniques: two 8-point scales of over-all 
value (one signed by the rater and the other 
unsigned), and two forms of the forced choice 
technique (forced choice pairs and a con- 
trolled check list). Rater groups were di- 
vided into highest, middle, and lowest thirds 
on the basis of aptitude test score, final class 
standing, final class standing predicted from 
aptitude test score, and on the criterion rank 
of over-all value achieved. For each third of 
the groups, separate validity estimates of rat- 
ings made were computed for both individual 
ratings and mean ratings where available. 

It was found that raters who scored high 
on aptitude, achievement at the College, and 
over-all value to the Army produced more 
valid ratings than did raters who scored lower 
on these variables. This trend was highly 
consistent for the 8-point rating scales, and 
clear, though not as direct, for forced choice 
pairs and the controlled check list. 


Received October 15, 1952. 
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When he first suggested an “actuality- 
measure” (A) this author (7, 8, 9) aimed at 
combining two aspects of rather strongly ego- 
involved states of public opinion. He hy- 
pothesized that a population of respondents 
shows relatively great ego-involvement in a 
question if two conditions are fulfilled: (a) 
Few “don’t know” responses; and (b) An 
even split between the Yes- and No-re- 
sponses.’ 

The formula which purports to measure the 
actuality of a given question for a given popu- 
lation of respondents was based on these two 
notions: 


a | oad 
oN py 


The evidence this writer has meanwhile col- 
lected seems to confirm the assumptions un- 
derlying this formula (10). 

In this paper we shall first try to summarize 
the available evidence for the designation of 
A as a measure of “actuality” or of the in- 
volvement of a group in a topic. This is sup- 
posed to furnish an empirical check of the 
validity of our measure.” Our second attempt 
will then be to present a statistical model from 
which the A-measure can be derived and 
which allows us to account for the empirical 
properties of A. 

After having rather regularly analyzed poll- 
reports during the last few years at least five 
conditions became clear which tend to result 
into relatively high actuality of questions. 
Each statement will be illustrated by one ex- 
ample; ,additional examples could easily be 
obtained. 


1We shall concern ourselves only with questions 
that are answered in terms of a trichotomy, i.e., in 
the affirmative (“Yes”), in the negative (“No”) or 
undecided (“Don’t know”). The respective percent- 
ages of the responses falling in each of these cate- 
gories are referred to as p,, p- and po. 

* A better check would obviously consist of an at- 
tempt to predict the relative values of A for ques- 
tions which had been answered by different popula- 
tions. Work in this direction is underway but to 
report on it would go beyond the scope of the pres- 
ent paper. 
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1. The more pertinent an issue is felt to 
be the higher is its actuality for a particular 
group of respondents. See Table 1. 


Table 1 


Distribution of Answers to the Question: “Do you 
think cigarette smoking is harmful or not ?’’t 


Not 

Don’t Harm 
know ful 
o % 


C 
45 


3 
10 24 


Harm 

ful 

Respondents % 
52 
66 


Cigarette smokers 
Non-cigarette smokers 


+t AIPO., Dec., 1949 


2. The more imminent the event is to which 
the question refers the higher is the actuality 
of the question. See Table 2. 

3. The greater the change involved in the 
question the higher is the actuality. See Ta- 
ble 3. 

4. The richer the available background of 
experience the higher is the actuality of the 
question (Saenger and Gordon, 19). See Ta- 
ble 4. 

5. The higher the educational and/or the 
socio-economic level of the respondents the 
higher actualities questions tend to attain. 
The data in Table 5 are based on 14 ques- 
tions reported by the Psychological Corpora- 
tion’s Barometer (Link, 13, 14, 15, 16). 

One may infer from these data that quite 
a few of the usual poll questions are tuned to 
the mentality of the above-average strata of 
our population. Thus they often reflect the 
problems of the “intelligentsia” rather than 
those faced by the “man on the street.” 
There are, however, interesting exceptions to 
the general trend (Link, 13). See Table 6. 

Cases like the one just mentioned can prob- 
ably be understood in terms of point one of 
the present list, i.e., with reference to the 
greater pertinence of the question to the 
lower socio-economic levels. 
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Table 2 
Distribution of Answers to the Question: “Do you think the U.S. will find itself in another 
world war within, say, the next year? (five years?) 


Within One Year 


Date of No 
Interview y q % 
May 1950 
Sept. 1950 
July 1951 
Dec. 1952 


70 


+ AIPO 


—4.91- 


Within Five Years 


No Op. No 

% % A 
2.45 
1.55 
1.22 


A 


19 24 
2.50 22 20 
4.08 18 


27 


Table 3 


Distribution of Answers to the Question: “Would you approve or disapprove of the following 
changes of postage which have been suggested ?’’t 


Per Cent 

Change of Postage 
Postcards from 1 ct. to 2 cts. 100 
Reg. mail from 3 cts. to 4 cts. 33 
Air mail from 6 cts. to 7 cts. 17 


t AIPO., Aug., 1949. 


Taken together, these examples seem to 
suggest the empirical validity of the actuality- 
measure. They represent, however, only a 
small sample from the total available evi- 
dence. 

While the empirical validity of the actu- 
ality-measure seems to stand on relatively 
firm ground the arbitrariness of its derivation 
caused the present writer considerable head- 
ache. It will be the task of the present dis- 
cussion to remedy this shortcoming. 

Let us assume, for the sake of a model, 
that our respondents were to give their an- 
swers on the basis of two balls drawn from 


Table 4 
Distribution of Answers to the Question: “Do you 
believe in the efficiency of the New York 
State law against discrimination?” 


Don’t 
Know 
oF 
( 


Respondents 
Persons who had experi 
enced job discrimination 
Others 


Increase 


Approve 
oy 
/0 
52 41 
33 59 


51 


No Op. _ Disapprove 
Oo oF 
A } 


two urns. Each of these urns contains “a” 
per cent white and “b” per cent black balls. 
The following combinations can thus occur: 
two white balls, one white and one black ball, 
two black balls. According to the rules of 
our game the respondents will have to render 
a “Yes-statement” whenever they draw two 
white balls, and a “No-statement” if both 
balls are black. In case they draw one white 
and one black ball the answer is going to be 
“Undecided,” or “Don’t know,” “Uncertain,” 
‘No opinion,” etc. 

The frequencies with which we expect these 


Table 5 


Actuality as a Function of the Socio-economic 
Level of the Respondents 


Average A 
Average (%) 
Socio-economic Level d (Total = 100) 
4.91 151 
4.04 131 
3.28 100 
2.03 6l 


100, 


A (highest 10 per cent) 
B (next 30 per cent) 

C (next 40 per cent) 

D (lowest 20 per cent) 
Total 
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Table 6 
Distribution of Answers to the Question: “Have 
businessmen a right to shut down?” 
Socio- Un- 
economic Yes certain No A 
oF oF oF \ oF 
/0 /0 é /O 
32 5.48 83 
36 6.48 98 
47 6.64 100 
53 7.78 117 
43.5 6.63 100 


ss eo 


Total 


responses to occur will follow the binomial 
expansion: 


(a+ b)* = a? (Yes) + 2ab 
(Don’t know) + 8° (No). 

The middle term in this expansion becomes 

thus: 
2ab = 2\/a°b® = po. 

We replace now a® and b* by the observed 
percentages of the Yes- and No-responses (/, 
and p_ respectively) and thus obtain for the 
middle term: 

bo =2V Pp. 

For all binomial distributions the follow- 

ing relationship holds: 


2Np.p 


0 


P= -= 1.00. 

This provides us with an easy way to ascer- 
tain whether or not an empirical distribution 
follows the binomial pattern. We have to re- 
ject the simple binomial (or “Bernoullian’’) 
model whenever the ratio P differs signifi- 
cantly from 1.00. 

The magnitude P becomes thus a measure 
for the applicability of the Bernoullian model 
to an observed distribution of responses. It 
can, however, be shown that our actuality- 
measure (A) serves this yery same purpose 
equally well: 


_4h+b 
po 
Since P equals 1.00 for all binomial dis- 


tributions A necessarily equals 0.50. 
It thus becomes clear that our actuality- 


p2 = 4.12. consequently: A= bP. 


Table 7 
Distribution of Answers to the Question: “Do you 
think that Socialism in England will 
succeed or fail?” 


Socio- Suc- Don’t 
economic ceed Know Fail 

eve % % % 
A 19 24 57 
B 13 31 56 
i 10 42 48 
D 11 60 29 
Total 12 41 47 


measure is nothing but a quantitative expres- 
sion for the appropriateness of the Bernoul- 
lian model for the representation of an em- 
pirical distribution of responses. It should be 
noted that this model does not presuppose 
any specific proportionality between the two 
initial probabilities “a” and “b.” The ap- 
pearance of a rather substantial majority for 
either “Yes” or “No” is therefore compatible 
with the Bernoullian model. 

The examples given in the first part of this 
paper have shown rather consistently actuali- 
ties higher than 0.50. Indeed, it is not easy 
to locate questions which yield actualities 
that low or lower. An example may be 
drawn, however, from one of Link’s polls 
(14). See Table 7. 

The response distribution of Group C (A 
= 0.52) comes indeed very close to the ex- 
pansion of (0.30 + 0.70)? = 9% (Succeed) + 
42% (Don’t know) + 49°% (Fail). 

Since poll data conform only rarely to this 
pattern we have to recognize that the Ber- 
noullian model is too simple to account for 
them. But we know already that its failure 
in that respect can be gauged from either 
P or A. 

The next step we have to undertake is to 
replace the model of two urns with the same 
probabilities (‘“a” and “b”) in each by the 
model of two urns with different probabilities. 
Obviously, our first model can be considered 
as a special case of this second, more general 
model. 

Let us assume that the respondents base 
their decisions on the drawing of one ball 
from each of two urns where the following 
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Table & 


The Markov Model of a Response Distribution 


Urn Probabilities 
I ay =(0.50 
Il de=0.70  be=0.30 

Ii] a,=0.10 


b, =0.50 
b,=0.90 
Responses 


% py =35 po =20 


p-=45 


probabilities prevail: 
a, + a, and b, + by. 


The corresponding percentages of the three 
categories of answers are: 


p, = a,"dz 
Po = (4,+by) + (a2°b;) 
p = bby 


This model always results in distributions 
which have actualities of less than 0.50. Its 
usefulness is therefore drastically limited. 

This will no longer be the case with the 
third model which employs the statistical 
theory of the “Markov Chains” (5). Let us 
assume that there are three urns with differ- 
ent probabilities for white:and black balls: 


a, > a; > az and bs < b, < bs. 


Whenever a subject has drawn a white ball 
from Urn I he is bound to draw his second 
ball from Urn II where the probability of a 
white ball is even greater than in the first urn. 
In the event of a black ball being drawn from 
the first urn the subject is required to draw 
the second ball from Urn III which gives him 
again an even higher probability to draw a 
black ball than the first urn did. This model 
abandons the independence condition of the 
Bernoullian model. A numerical example 
may help to clarify this notion. See Table 8. 

The essential feature of this model is that 
the probabilities which prevail for the draw- 
ing of the second ball depend on the result of 
the first drawing. Such probabilities have 
been called “dependent” or “conditional” 
probabilities. It can be seen easily that the 
Markov model includes the Bernoullian model 
as a special case of a; = ad) = ay. 


The out- ' 


come of a so-called Markov process is de- 
fined by the following equations: 


Pp = a;"ay 
Po = (€,*be) + (b;+a3) 
p = b,-bs 


Though it may seem as if we had three 
equations for the determination of the three 
unknown variables (a;, @2 and a3) we will not 
be able to solve these equations since only two 
of the p-values are independent. The prob- 
lem is therefore bound to remain underde- 
termined unless we introduce an arbitrary 
assumption with respect to the initial prob- 
ability a@,. Our assumption may, for instance, 
be: a, = b;=0.50.* Consequently, the fol- 
lowing equations will define the conditional 
probabilities: 


. 
“rr Ps; 


po—ayb2 
es 


Since the observational data we collect by 
means of poll questions do not allow us to de- 
termine all three probabilities needed for the 
Markov model its usefulness may seem to be 
sort of academic. Yet, it should be pointed 
out that this model shows one property which 
furthers our understanding of the processes 
which underlie the formation of public opin- 
ion. In order to become aware oi this aspect 
we have only to replace the term “urn” by 
the term “source of information.” The 
Markov model tells us that the conclusions 
our respondents draw from one source of in- 
formation (these conclusions may be either 
favorable or unfavorable with respect to the 
question at issue) determine their exposure to 
other sources of information (some of them 
being more and others less likely to confirm 
a favorable attitude). What accounts ulti- 
mately for an observed response distribution 
is thus a certain amount of selectivity with 
respect to the sources of information to which 
the respondents expose themselves. What 
this boils down to is that the drawing from 
different sources of information does not oc- 
cur in a statistically independent manner. On 


= 2(p.+ po) — 1.00. 


8 This assumption becomes untenable in the case 
of: p. + fo < 50. 





The Actuality Measure in the Study of Public Opinion 


the contrary, the sources of information which 
our respondents actually recognize are in most 
cases intercorrelated. 

Once the first choice has occurred the sub- 
sequent choices tend to be made on the basis 
of sources of information which are more 
likely to support the initial choice than to 
contradict it. Thus a series of choices gets 
underway which assures the individual sub- 
ject of a relatively stable and un-ambivalent 
attitude. By the same token we may infer 
that neutral responses (‘Don’t know,” etc.) 
tend to vanish in the group of respondents as 
a whole. What we have called “actuality” 
and have operationally defined by our for- 
mula thus serves as an indicator for the 
amount of “bundling” of sources of informa- 
tion which prevails in a given group of re- 
spondents with respect to a given issue. 


Table 9 


The Markov Model of Two Correlated Sources 


Before Debate After Debate 


P+ Po Po 


36 46—«18 


46 
55 


re = O.B3 


In order to explore this last point further 
we can restate the Markov model in the fol- 
lowing way: We assume two sources of in- 
formation (“urns”) with the same probabili- 
ties for either positive or negative statements 
in each of them: a; = ds; 6; = bs. We can 
thus set up a fourfold table in which all sorts 
of trichotomic response distributions can be 
arranged as is shown in Table 9.* 

The data of Table 9 are taken from an ex- 
periment by Millson (17) in which the au- 
thor arranged for group discussions on the 
topic of unemployment insurance. Before 
and again after debate the participants were 


4 The tetrachoric correlation coefficients (r;) are 
read from the well-known Thurstone Tables (3). 
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asked to state their opinions. As can be seen 
from Table 9 the debate resulted in a height- 
ened actuality of the question. This is a 
fairly common event (10). In the lower 
half of Table 9 the same data have been 
brought in the form of fourfold tables in 
order to allow for the computation of tetra- 
choric correlations. The value of py had thus 
to be divided into two cells, i.e., the combina- 
tion of a, with 5. and of a. with b,. One half 
of Po was allotted to either cell. 

The interpretation that can be given to 
these data reads: Whereas the respondents 
used the sources of information available to 
them before the debate in an (almost) in- 
dependent manner a considerable degree of 
bundling or patterning occurred after the de- 
bate. The rise in actuality (from 0.55 to 
2.26) corresponds with an increase in the 
degree of bundling (from r, = 0.08 to r;, = 
0:83). In fact, there exists, in general, a defi- 
nite relationship between A and the corre- 
sponding coefficient of correlation r;. See 
Figure 1.° 

Actualities below 0.50 correspond to nega- 
tive correlations. This means that the re- 
spondents who have drawn their conclusions 
from the first source of information in a posi- 
tive manner are more likely to draw a nega- 
tive conclusion from the second source they 
consult, and vice versa. This is seldom the 
case. An example can be seen in the behav- 
ior of socio-economic group D in Table 7. 
In introspective terms this may be either con- 
sidered as “disappointment” or as a striving 
for objectivity. 

As we reach the end of our present investi- 


*An empirical equation has been 
curve 


fitted to this 


r, = 0.96 ae * 


For A-values over 0.50 the agreement between ex- 
pected and observed r;-values is excellent, below 0.50 
it is tolerable. It had been hoped that this relation- 
ship would provide us with a test of significance for 
A. This hope may, however, not materialize be- 
cause of the great difficulties that enter into the de- 
termination of the significance of differences between 
tetrachoric coefficients. In the future a significance 
test for A in terms of the corresponding Chi-squares 
seems to be more likely. It can, however, be reason- 
ably inferred from Figure 1 that relatively small 
numerical differences between A-values in the range 
from 0.50 through 3.50 are much more likely to be 
significant than numerically larger differences be 
tween higher A-values. 
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Fic. 1. The relationship between actuality (A) and 
the bundling of sources of information (r+). 


gation it may be said that the actuality-meas- 
ure indicates the amount of discrepancy that 
exists between an observed response distribu- 
tion and the kind of distribution that one 
would expect on the basis of the Bernoullian 
model. This discrepancy can be expressed in 
terms of the correlated functioning of two 
sources of information (Markov model). 
Needless to say, no model can ever be taken 
literally. It is quite artificial to argue that 
always two and just two sources enter into 
the determination of a person’s attitude to- 
wards a given social issue. Indeed, there is 
little doubt that we are exposed to many 
more sources of information with respect to 
most issues.° It seems, however, that the 
more sources of information the ordinary per- 
son, in accordance with his socio-economic 
and/or educational level, consults, the 


6 The “interference-hypothesis” which asserts “that 
any communication which successfully modifies a per- 
son’s beliefs will reduce the opinion-impact of any 
subsequent event or communication that tends to 
produce antithetical beliefs” has been recently con- 
firmed (11). 


stronger becomes his chance to hit upon cor- 
related sources. This is in line with point 
five in the first part of this paper. The other 
four points previously made can now be sum- 
marized by saying that the more important a 
decision we have to make, the more prone we 
are to expose ourselves to correlated sources 
of information. Yet, this statement requires 
at least one qualification. As has been shown 
in an earlier paper (9) there exists a negative 
correlation between the actuality and the ex- 
perienced difficulty of questions. Our subjec- 
tive experience that a question is difficult 
seems to correspond with an un-bundling of 
sources of information. Ultimately this causes 
us to shift in the direction of the Bernoullian 
model. 

To recognize fully the eventually large 
number of sources of information would, of 
course, complicate our derivations. The basic 
postulate, however, will probably remain un- 
altered, that is, that one can either use the 
multitude of sources of information in a com- 
plete and unselected manner or use them se- 
lectively. From a theoretical point of view 
the first procedure is undoubtedly preferable; 
in practice the latter seems to be the rule. To 
follow this “rule” minimizes the ambiguity of 
perceived situations and thus eases the burden 
of uncertainty.’ Ceteris paribus this tendency 
may be expected to show up more strongly 
the more deeply ego-involved we are in cer- 
tain issues. Actuality measures the strength 
of this tendency. 


Summary 


1. Poll questions which can be answered by 
either “Yes,” “No” or “Don’t know” yield re- 
sponse distributions which can be compared 


7 This very same mechanism has been described in 
several situations by different terms. For instance as 
the “selectivity” of learning and forgetting (5, 12), 
or as “intolerance of ambiguity” (6) with regard to 
perception. The relationship between “intolerance of 
ambiguity” and ethnocentrism has been demonstrated 
(1). A comparable tendency to escape from ambi- 
guity seems to underlie the “Halo-Effect” (Thorn- 
dike) in personality judgment. The correlated use 
of indicators refers also to this situation (2). H. 
Werner’s (20) concept of “rigidity” is also based 
upon the notion of either too much isolation or too 
much overlapping of subareas, i.e., upon their posi- 
tive or negative correlation. The “hypothesis-con- 
firmation theory” of Postman (18) provides a suit- 
able frame of reference for these phenomena. 
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with binomial expansions. 

2. The actuality-measure indicates the dis- 
crepancy between an observed response dis- 
tribution and that expected from the binomial 
model. 

3. All kinds of trichotomic response dis- 
tributions can be fitted to the Markov model 
of dependent probabilities. 

4. Under simplifying conditions, the actu- 
ality-measure becomes an indicator of the 
amount of bundling (or correlation) among 
the sources of information to which the re- 
spondents have exposed themselves. 

5. The bundling of sources of infor nation 
increases with the subjectively felt importance 
of the issue to which the question relates and 
also—in general—with the socio-economic 
and/or the educational level of the respond- 
ents. It decreases with the subjectively felt 
difficulty of the issue. 


Received August 20, 1952. 
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A Biasing Factor in Essay Response Frequency 


Erwin K. Taylor and Dorothy E. Schneider 


Personnel Research Institute, Western Reserve University 


In order to get descriptive phrases for use 
in developing an evaluation form, question- 
naires were mailed to 955 randomly selected 
members of a professional organization, the 
American Dietetic Association. The question- 
naire explained the purpose of the study and 
asked each respondent to describe an asso- 
ciate at a level of competence specified on the 
form. Each questionnaire specified a single 
level out of ten possible levels. Ninety-five 
or ninety-six questionnaires were sent out for 
each level. Of the ten levels, “1” was con- 
sidered best, and “10” poorest. Although 
there was some feeling on the part of the 
present writers that the returns, being on an 
anonymous and voluntary basis, would yield 
either a J- or U-shaped distribution, there 
was no published evidence to justify unequal 
distribution in mailing of the forms. Hence, 
each level was requested from an equal num- 
ber of recipients of the questionnaire. 

In addition to the descriptive essays, re- 
spondents were asked a number of questions 
regarding the type of work engaged in when 
they were acquainted with the dietitian de- 


scribed, length of acquaintance, and working 
relationship between the two. 

The questionnaires were mailed from Cleve- 
land on June 19, 1952; the first reply was re- 
ceived on June 24, and by July 10, the “dead- 
line” requested on the questionnaire form, 130 
forms had been returned. Within the two 
weeks following, 14 more were received, bring- 
ing the total to 144, or about a 15% return. 

The forms which were returned reveal some 
interesting points. The distribution at each 
level of competence is shown in Table 1, ac- 
cording to whether the respondent selected a 
subordinate, co-worker, superior, or student 
as subject for the essay. 

It will first be noted that the distribution, 
while not horizontal, does not reveal sufficient 
U or J shape to be so named. The mean 'of 
5.4 is very close to the 5.5 which would be ex- 
pected in a horizontal distribution. At only 
two levels, 4 and 6, are the frequencies more 
than 5 below the maximum frequency. 

A Chi-square test was applied to the total 
frequencies and revealed no statistically sig- 
nificant deviation from the theoretical recti- 


Table 1 





Distribution of Returns on Questionnaire Form Requesting Descriptive Essays 





Subor 
dinate 


Level of Competence 
of Person Described 





1 (Best) si 6 
? 


sD vue Wi 
wie ee YI YW 


x 


9 
10 (Poorest) 
Total 


Mean 


Relation of Subject to Writer of Essay 


Superior Student 





A Biasing Factor in Essay Response Frequency 


linear distribution. This indicates the ab- 
sence of bias in the returns in terms of the 
level of competence of the individual to be 
described. 

Thus, while it has been conjectured that it 
is easier to evaluate personnel at the extremes 
of the effectiveness distribution, it does not 
appear to be necessary to take this factor into 
account in planning the collection of data of 
this nature. Responses were received with al- 
most equal frequency for ratees at each of the 
ten effectiveness levels used in this study. 

When no restriction was placed upon the 
selection of subjects for the essays, other than 
the level of competence, about the same num- 
ber of supervisors and subordinates were se- 
lected. However, some rather striking differ- 
ences will be observed in the mean levels of 
competence of the two groups. It would seem 
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that the more competent “superiors’’ were re- 
membered by the recipients of the question- 
naire and selected for description, while those 
who were to describe less competent individu- 
als tended to select subordinates. 

It is interesting to note that no respondent 
who was asked to describe a No. 1 person- 
the best—described a co-worker, and that 
fewer co-workers were described than either 
superiors or subordinates. Although there is 
the same proportion of co-workers as subordi- 
nates in levels 6-10, the mean is lower. This 
is largely a function of the zero frequency at 
level 1. 

The number of descriptions of students is 
small, but no unusual trends are noted in 
manner of selection. 


Received October 15, 1952. 
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Rating Patterns for Maximizing Competition and Minimizing Number 
of Comparative Judgments Necessary for Each Rater 


Ray H. Simpson 


Department of Educational Psychology, University of Illinois 


The problem considered in this paper is 
represented by a situation which contains the 
following features: 

a. A large number of individuals or writ- 
ten products are to be ranked. 

b. The time required to evaluate and give 
a rank to each individual or product is of 
such magnitude that any single judge cannot 
be asked to rank more than 3, 4, or 5 indi- 
viduals or products. 

c. The researcher or administrator wants to 
use a large number of judges in order to maxi- 
mize the reliability of the combined rating or 
ranking. 

d. Each individual or product should di- 
rectly compete with as many other individu- 
als or products as possible. 

e. The total group of individuals or prod- 
ucts with which a particular individual or 
product competes should represent a random 
sample of the total group of competitors 
against whom he is to be ranked. 

The method of paired comparisons would 
obviously not be appropriate since it would 
take too much time and be too fatiguing to 
the judges. Forty individuals or products 
to be ranked, for example, would involve 
n(n — 1)/2 or 780 pairs to be compared by 
each judge. 

Consideration was given to the possibility 
of using a technique suggested by Guilford’ 
which involves selecting from all the individu- 
als or products a limited number to become 
the basis for a scale. This alternative was 
not used because of the difficulty in selecting 
appropriate products or individuals at ap- 
proximately equal intervals along the scale 
and because of the volume of work still re- 
quired of each judge. 

The technique described by Uhrbrock and 


Richardson? was also considered. In it one 
‘Guilford, J. P. Psychometric methods. New 
York: McGraw-Hill, 1936. 
2 Uhrbrock, R. S. and Richardson, M. W 
analysis. Personnel J., 1933, 12, 141-154 


Item 


breaks the individuals to be rated into four 
groups. Within each group each man is com- 
pared with every other man in his group and 
also with each of five “key” men. These lat- 
ter five form a type of interlocking yardstick. 
While this method is much .more economical 
of the time of judges than the paired com- 
parison technique, it still was too time con- 
suming to meet all of the requirements of the 
writer’s situation. As a result, the patterns 
described below have been developed. 


Rating Patterns 


Table 1 illustrates a pattern to be used 
when: (a) there are 21 individuals or prod- 
ucts to be ranked from highest to lowest; (b) 
there are to be 21 raters (A through U); (c) 
each individual or product is to compete with 


Table 1 


Interlocking Design for Having 21 Raters Give Com 
petitive Ranks to 21 Individuals or Products 


Rater Individuals or Products to be Rated 


A 2 7 9 19 
B 3 8 10 20 
Cc ; 4 9 11 21 
D 5 12 

E d 11 13 

F 12 14 

G 13 15 

H 14 16 

I 15 17 

J 16 18 

K ‘17 19 

L t 18 20 

M < 19 21 

N ; 20 1 

Oo : 21 

P 1 

Q 

R 3 
S 4 
T 5 
U 6 








Rating Patterns 


Table 2 


Abbreviated Rating Patterns with Each Judge Rating Five Individuals or Products 


Total Number to be Rated—25 


Total Number to be Rated—29 








Rates 





4 
5 
6 


23 
24 
25 





Total Number to be Rated—26 


Judge 


Rates 


2 4 8 
3 5 9 
4 6 10 


1 
2 
3 





Total Number to be Rated—27 


Judge Rates 


A Cie ae 8 
b & Biuc8 
Cc ‘ 4 6 10 


5 
6 


7 


Total Number to be Rated—28 


——_—_—_4+—_____—__- 


Judge 


= A 7 . 4 
I 4 5 
ts d 6 


Rates 


Z : 10 


AA 27 11 


BB 


28 


12 








1 Similar designs with the same initial sequence can be 


Judge 


Rates 





A 
B 
© 


AA 


cc 


Judge 


Judge 


Judge 


A 
B 
G 


DD 
EE 
FF 


27 
28 
29 


29 
30 


29 
30 
31 


30 
31 
32 


Total Number to be Rated 


Rates 


4 
5 
6 


1 


30 2 


1 3 


Total Number to be Rated—. 


Rates 


30 
31 


1 


Total Number to be Rated—32! 


Rates 
4 
5 
6 


31 
32 


used with groups larger than 32. 
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as many other individuals or products as pos- 
sible; and (d) no judge or rater is to be asked 
to rank more than five individuals or prod- 
ucts. The time involved in the job of rating, 
reading, or observing necessitates this last re- 
quirement. 

Examination of Table 1 will show that in- 
dividual or product number 9, for example, is 
in competition with each of the 20 other num- 
bers. This means that the final rank for 
number 9 is as fair a rating as one can get 
without excessive work on the part of indi- 
vidual judges. 

This particular design was used by the 
writer in a class of 21 students where each 
student studied and rated, on the basis of 


Ray H. Simpson 


criteria previously established, the learning 
products of five peers. For each student to 
rank more would have been too fatiguing. 
The sum of all ranks assigned a particular 
individual was used to rank the 21 students 
in the class. Other patterns, based on simi- 
lar designs, are represented in essence in Ta- 
ble 2. 

The technique and patterns suggested here 
have wide applicability. A few of the addi- 


tional areas where use would be feasible would 
be the following: ranking personnel such as in 
an industrial, military or educational situa- 
tion; rating short stories; and ranking art 
forms for esthetic qualities. 


Received September 2, 1952 
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Some Primary Ratable Characteristics of Instructional Films ' 


Philip Ash* and Thelma R. Hobaugh 


The Pennsylvania State College 


A central problem facing the instructional 
film producer on the one hand, and the teacher 
on the other, is the evaluation of the film as 
to its adequacy as a teaching aid. 

The primary objective of an instructional 
film is, generally, to instruct. Therefore, the 
first criterion of the adequacy of a film as an 
instructional device must be: how well does 
the film communicate its content—how much 
is learned from it? 

However, a second important objective of 
an instructional film is to interest, to hold at- 
tention, possibly to entertain in the broad 
sense. In some of its uses, for example as an 
overview to a unit of instruction, the teacher 
might intend that the film motivate the stu- 
dents to want to learn about the content, with 
little emphasis on information directly ac- 
quired from the film. Furthermore, it seems 
likely that the extent to which a film is ‘‘in- 
teresting” in the sense that it gains and holds 
the attention of the students will influence the 
extent to which it communicates effectively. 

Three kinds of estimates of the quality of 
an instructional film therefore suggest them- 
selves: first, measures of learning based on 
test results; second, estimates (judgments, 
ratings) by people who have seen the film as 
to the extent to which people will learn from 
the film; and third, ratings of the affective 
impact of the film more or less independently 


1 The research on which this article is based was 
conducted under the auspices of the Instructional 
Film Research Program under Contract N6é-ONR- 
269, Task Order VII with the Special Devices Center 
of the Office of Naval Research. This research is re- 
ported in Technical Report SDC 269-7-23, Film 
Profiles. The authors gratefully acknowledge per- 
mission to analyze the correlation matrix that evolved 
out of the Ph.D. dissertation completed by Loran C. 
Twyford: A Comparison of Methods for Measuring 
Profiles of Learning from Instructional Films, The 
Pennsylvania State College, 1951; Publication No. 
3314, University Microfilms, $2.76. Ann Arbor, 
Michigan. Dr. Ash was responsible for planning the 
study and writing the report; Miss Hobaugh was re- 
sponsible for carrying out the factor analysis. 

2Dr. Ash is now a member of the Industrial Re- 
lations Research Department, Inland Steel Company, 
East Chicago, Indiana. 
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of its effectiveness in imparting factual in- 
formation. 

It is the purpose of the present research to 
determine the extent to which these kinds of 
estimates are intercorrelated, to answer the 
question as to the extent to which, from a 
rating of teaching effectiveness or affective 
quality, it is possible to predict measured 
learning. 

A rough check on the teaching effectiveness 
of an instructional film may be made by ad- 
ministering, both before and after the film, a 
test generally covering the content of the film. 
Gains in test scores would reflect the over-all 
contribution of the film to the students’ fund 
of knowledge. Such a test, however, would 
not clearly indicate which parts of the film 
were effective and which were ineffective. 

A better method of evaluation might in- 
volve the development of a profile measure- 
ment which shows which parts of the film are 
effectively imparting information and which 
are less effective or ineffective in this respect. 
Furthermore, technics are available for ob- 
taining rating profiles of the “attention value” 
and other affective attributes of a film, and 
for obtaining judgments of teaching value. 
Profile methods of summating audience rat- 
ings with respect to successive sections of 
programs (entertainment films, radio shows) 
have been developed extensively during the 
past ten years, primarily in the radio and 
motion picture industries.* Little comparable 
work has been done with instructional films, 
however. 


Film Profile Analysis 


Under the auspices of the Instructional 
Film Research Program at The Pennsylvania 
State College, Dr. Loran C. Twyford con- 
ducted an extensive study of the feasibility of 
a variety of methods for developing profiles 
of audience evaluations of the instructional 


3 An extensive review of profile analysis technics 
in radio and motion pictures is included in Dr. Twy 
ford’s study, op. cit. 
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film. These profiles were graphs, drawn 
against time as the base-line, of the summed 
responses of the audience to several dimen- 
sions of the film. 

The profiles he collected may be classified 
into three groups: 

(1) Profiles of measured learning and learn- 
ing gains. These profiles were based upon an 
exhaustive test of the film content. The test 
items were true-false form; every fact pre- 
sented in the film was covered by an item, 
and each item could be related back to a spe- 
cific point (in time, sequence, and footage) 
in the film. : 

(2) Profiles of estimated teaching effective- 
ness. For these profiles the subjects were 
asked: (a) to rate whether they thought they 
were learning; (b) to rate whether they 
thought students would learn; or (c) to rate 
(on a third showing) whether they had 
learned the content presented. The ratings 
were made during the film showing, on a five- 
point scale. The subjects made their re- 
sponses by means of the Film Analyzer ‘ sys- 
tem, which provides for the collection by 
polygraphic recording of the responses of each 
of a group of 40 subjects. 

(3) Profiles of affect dimensions. Profiles 
were collected on the dimensions: (a) ‘“Like- 
Dislike the film”; (b) ‘The film is Clear-Un- 
clear”; and (c) “The film is Good-Bad.” 
These profiles also were made on five-point 
scales and the judgments were recorded by 
means of the Film Analyzer system concur- 
rently with the viewing of the film. 


Procedures 


In all, Dr. Twyford collected data on 276 high- 
school and college students, divided into seven 
equated groups. 

The students in the experiment met as intact 
classes. A given class was then randomized into 
seven groups. Each of the seven groups in a 


*At each of the 40 stations (chairs) of the Film 
Analyzer system a box containing five piano-like keys 
is located. Each subject presses a key signifying his 
response, and a simultaneous record of the 40-re- 
sponse channels is made on a moving paper. The 
five choices are coded so that each response channel 
produces dashed, solid, or a pair of dashed and solid 
lines identifying the key being pressed. For a de- 
scription, see Carpenter, C. R., et al. The Film Ana- 
lyzer. Special Devices Center Technical Report 269— 
7-15, Instructional Film Research Program, The 
Pennsylvania State College, 1950. 
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class followed a different one of seven experi- 
mental procedures. 

The film shown to the experimental population 
was a 10-minute section of a longer film on pre- 
cision measuring instruments. The original film 
had been designed by the Instructional Film Re- 
search Program. It is essentially an informa- 
tional film which undertakes to show various 
kinds of precision measuring instruments and 
their method of use. The 10-minute section 
used in the experiment was a complete and in- 
tact section of the original. 

Groups I, II, and III each saw the film three 
times, and made a continuous rating on each oc- 
casion. Group IV took Form A of the test after 
seing the film once, Group V took Form B after 
seeing the film once. Groups VI and VII took 
Forms A and B respectively without seeing the 
films. 

The experimental directions were (in part) as 
follows: 

1. “J am learning.” Specific instructions given 
to students making this rating were: 

“You are to rate the film on the basis of your 
learning from the film. When facts are presented 
by the film that you already know, you should 
report that you are not learning. Some facts in 
the film may be so difficult that you could not 
answer questions about them if you were asked 
to do so after the film showing. These facts were 
not learned. Learning means that some change 
has occurred to you that we could discover by 
comparing your knowledge before and after the 
film showing.” 

2. “I predict learning.” Specific instructions 
given to students making this rating were: 

“You are to predict the amount of learning you 
would expect a group composed of your class- 
mates to learn from a single showing of the film. 
The group will not be learning much if the mate- 
rial being presented is previously known. The 
group will not be learning if the material being 
presented is too d.fficult. Learning may occur 
when the film presents facts that are new. 
Learning means that some change has occurred 
to the person that we could discover by compar- 
ing his knowledge before and after the film show- 
ing by means of tests.” 

3. “I like-dislike.” Students making this rat- 
ing were given the following instructions: 

“You are to rate the film according to the de- 
gree to which you like the parts of the film. If 
you like a part very well, depress key No. 5. If 
you dislike a part of the film, depress key No. 1. 
The keys that lie between should be pressed to 
show just how much you like or dslike each 
part. It will be possible for us to improve the 
film by making the entire film similar to the 
parts that you indicate you like. Rate the film 
from beginning to end.” 

During a second showing of the film to the 
same groups, each group was asked to respond a 
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second time, using the same judgment that had 
been used the first time. 

During the third showing, the students in one 
group were asked to rate how much they had 
learned; in the second group they were asked to 
rate how clear the film was; in the third group 
they were asked to rate the excellence of the film 
as a teaching aid. 

The remaining four groups of each class were 
handled as follows: 

One group took form A of a true-false test 
which exhaustively sampled the information con- 
tained in the film (in both pictures and com- 
mentary ). 

A second group took form B of the same test 
(true questions of form A were false questions in 
form B; false questions in form A were true 
questions in form B). 

These two groups acted as a control on the 
pre-film knowledge of the experimental popula- 
tion; they did not see the film. 

The two remaining groups received no pre- 
tests. They were each shown the film, and then 
were respectively given one of the two test forms 
mentioned above. 

The nine rating profiles (Groups I-III) were 
each established by taking the average rating for 
the group for every two feet of film, a total of 
151 points for each profile. 

The test questions were distributed approxi- 
mately evenly to provide a measure in each in- 
terval. The four basic test profiles (for Groups 
IV-VII) were prepared by calculating the mean 
score for each point on the time axis. Some 
questions were used at more than one point in 
the film. These four basic profiles generated a 
variety of profiles of learning gains (difference 
between a post-test profile and an appropriate 
pre-test profile ). 

The list of the profiles is as follows: 


1. Footage—number of feet of elapsed film, 
measure of the time base. 

. I am learning—Ist showing: Ratings of ex- 
tent of learning during first viewing of film 
by Group I. 

. Like-Dislike—1st showing: Ratings of degree 
to which viewer liked the film, during first 
viewing of film by Group II. 

. Predicted learning—Ist showing: Ratings of 
the extent to which one’s classmates would 
learn the content, during the first viewing of 
the film by Group III. 

. I am learning—-2nd showing: As for profile 
2, during second viewing by Group I. 

. Like-Dislike—2nd showing: As for profile 3, 
during second viewing by Group II. 

. Predicted learning—2nd showing: As for pro- 
file 4, during second viewing by Group III. 

. Rated end knowledge—3rd showing: Ratings 
of amount learned during previous showings, 
during third viewing by Group I. 
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9. Clarity: Ratings of the extent to which the 
film presentation was clear and understand- 
able, during third viewing by Group II. 

10. Good-Bad film: Ratings of the excellence of 
the film as a teaching aid, during third view- 
ing by Group III. 

. Test A learning: Mean score of Group IV 
minus mean score of Group VI (control or 
no-film group for Form A) for each profile 
point. : 

. Test B learning: Mean score of Group V 
minus mean score of Group VII (control or 
no-film group for Form B) for each profile 
point. 

. True questions learning: Mean score on true 
questions from Groups IV and V minus mean 
score on true questions from Groups VI and 
VIL. 

. False questions learning: As for profile 73, 
but for false questions. 

. Comparable questions learning I: Mean score 
for Group V minus mean score for Group VI, 
for comparable questions. 

. Comparable questions learning II: As for 
profile 15, Group IV minus Group VII. 

. Maximum learning: Profile obtained by as- 
suming maximum learning. 
Terminal knowledge, Form A: 
mean scores for profile points. 

. Terminal knowledge, Form B: As for profile 
18, for Group V scores. 

. Terminal knowledge, true questions: Group 
IV mean scores and Group V mean scores on 
true questions only. 

. Terminal knowledge, false questions: As for 
profile 20, for false questions 


Group I\ 


Purpose of Present Analysis 


Dr. Twyford was primarily interested in 
developing profile construction methodology, 
and in comparing the relative efficiency, with 
measured learning as a criterion, of the af- 
fect rating profiles and the estimated teach- 
ing effectiveness profiles for detecting the 
strong and weak points of the film. Part of 
his analysis, therefore, involved correlating 
the profiles. This was done by taking, for 
each profile, a measurement at every two 
feet of film length (151 measurements in all) 
and intercorrelating the profile arrays.* 


® Before further analysis, Dr. Twyford applied a 
series of corrections to his correlations. These cor- 
rections were not employed in this analysis. These 
corrections for “drift,” “lag,” and “carry-over” in- 
volved either smoothing lines or partialling out time 
They were not applied in this factor analysis; first, 
because they had little effect on the observed cor 
relations; second, because the partial correlations 
would be taken care of in the factor matrix; and 
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Table 2 
Factor Loadings Before Rotation (Fo) 
Variable I 1V 
.156 24 .140 
.682 ; — 235 .199 
504 ; — .045 
582 —, : 157 
694 ‘ - 188 
456 -. ; — .192 
653 -, : 188 
403 : ; 434 
538 ; ° .258 
.696 — —. 094 
.756 ‘ : .163 
708 ‘ . —.188 
680 J —, - 200 
774 : ; 133 
.672 F — 21 155 
716 ae —. ~.107 
697 j 7 143 
.599 d , .233 
.638 ‘ ‘ 205 
.599 , ; 241 
600 : 182 


Table 3 


Rotated Factor Matrix (V = FA) 


Test Rating Terminal Terminal 
Scores Scales Knowledge Knowledge 
Factor Factor Factor Factor 
Variable (1I’) (II1’) a (V’) b (VII’) 


1 ~.070 344 — .093 .006 
106 808 436 - 095 
010 7146 — .026 .068 
O10 835 .234 031 
175 759 114 .037 
057 678 111 392 
O85 833 268 -.013 
027 685 — 022 423 
020 788 .199 340 
O84 §99 314 059 
787 055 O88 022 
780 - 004 133 005 
709 013 101 095 
850 044 087 094 
173 005 ~ O18 079 
753 O87 054 O83 
.928 063 273 300 
864 -.057 391 184 
838 ~ 003 133 406 
839 010 367 524 
$30 091 127 280 
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Table 4 


Cumulative Transformation Matrix (A) 


Ill’ 
579 

— 797 
.223 
000 
192 
000 
000 


Variable II’ 

I : 735 

Il O18 625 

III .022 

IV : .096 

V j ~.244 

VI ; .000 
VII 





Iv’ V 
089 303 
102 .000 
056 

~— 978 

150 
000 
.000 


Table 5 


Cosine Matrix (C = AA’) 


Variable I’ 


Wey ~ 1,000 


IIl’ 


000 
— .080 
1.000 
000, 
.273 
000 
304 





.000 
1.000 
— .080 
003 
148 
000 
348 


lV 
Il’ .000 
III’ .000 
IV’ 000 
Vv’ O50 
VI’ 000 
VII’ 000 


It is the purpose of the present study to 
analyze the resulting correlation matrix, to 
determine whether the domain as tapped by 
the twenty profiles can be readily reduced to 
a fewer number of dimensions. It is obvious 
that the measured learning profiles at least 
must intercorrelate fairly highly, since they 
were all based on the same instruments. It 
was the initial hypothesis of this analysis, 
therefore, that the whole matrix could be re- 
duced to three factors: a measurement fac- 
tor, with loadings on the tests; a learning 
factor, with loadings on both the tests and 
the estimated teaching effectiveness ratings; 
and an affective rating factor. 


Results 


Table 1 presents the intercorrelation matrix. 
A centroid analysis was applied, yielding the 
(unrotated) solution given in Table 2. Rota- 
tion yielded the final factor matrix in Table 
3. The transformation and cosine matrices 
are given in Tables 4 and 5. 


third, because the corrections were applied not to 
the entire correlation matrix, but to different sec- 
tors of it. 


IV’ 


000 
003 
000 
1.000 
—.576 
000 
000 


VII’ 
.000 
348 
300 
.000 

— .068 
000 
1.000 


Very early in the rotations, two factors 
practically orthogonal to each other with large 
loadings emerged. One included all the test 
profiles (II’), the other included all the rat- 
ing profiles (III’). For neither of these, nor 
for any other factor, was the projection of 
film footage (a measure of the time base) 
significant, indicating that these were not 
simply functions of sequence. 

Repeated rotational efforts failed to lead to 
the identification of any other significant fac- 
tors. There is a suggestion of overlap be- 
tween ratings of learning and measured learn- 
ing in factors V’ and VII’, but the loadings are 
too small to warrant any large degree of con- 
fidence. 


Summary 


This analysis suggests that test-measured 
learning gains from a film are more or less 
independent of ratings of learning or ratings 
of affective qualities of the film. Further- 
more, the results indicate that all the rating 
scales used have a large common-factor vari- 
ance. Whether viewers rate on an “I am 
learning” scale, a “Like-Dislike” scale, a 
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“Good-Bad Film” scale, or any similar scale, 
much the same function seems to be rated. 
The findings of this analysis do not agree 
completely with the conclusion of the original 
study that a combined test measure is pre- 
dicted to a significant extent by ratings on 
the scale “I am learning.’”’ Examination of 
the correlation matrix before and after cor- 
rections for “lag,” “drift,” and “carry-over” 
(see footnote 5) shows that correlations be- 


299 


tween this rating scale and the test score pro- 
file were uniformly stepped up as a result of 
the corrections. It is possible that inclusion 
of these corrections would have led more defi- 
nitely to the establishment of a common 
learning factor, with saturations both on the 
tests and on the scales rating learning func- 
tions. 


Received October 27, 1952. 
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The Relation of Light Intensity to Accuracy of Depth Perception 


A. S. Edwards 
The University of Georgia 


The following experiments were performed 
to discover the relation of light intensity to 
the accuracy of visual depth perception. 


Procedure 


In the first three experiments two lights 
were used, one of 50 fc, the other of 12 fc. 
In the fourth experiment, three intensities of 
light were used, 12 fc, 50 fc, and 100 fe. 
With all lights, shadows were eliminated. 

Apparatus. ‘The apparatus was a modified 
Howard-Dolman depth perception apparatus. 
Instead of the upright poles, two blocks of 
wood were substituted. These blocks were 
made to hold rectangles of heavy pasteboard 
on which were pasted gray or colored paper. 
The size of the stimulus thus presented was 
114,” by 214". The headrest was at 20 feet 
distance and kept the S from seeing the tops 
of the blocks. A standard gray (Stoelting 
gray No. 19) was always used. The movable 
stimulus had one of the Stoelting grays or 
colors as follows: gray No. 19, blue No. 13, 
green No. 8, yellow No. 4, or red No. 1. In- 
tensities of lights were checked by means of 
a new light meter from the Physics Depart- 
ment and also by means of one from the 
local electric power company. New papers 
were purchased for the experiments. 

Subjects. The Ss were students chosen at 
random from classes in the University. Only 
those with at least 20/20 vision, or vision ccr- 
rected to 20/20, were used. The Ortho-Rater ? 
was used to check vision. Color blind Ss were 
eliminated. 

Instructions. Ss were told, “The object of 
the experiment is to see how accurately you 
can judge distance by aligning a movable ob- 
ject with a stationary one. You are to take 
these strings and pull the right hand object 


1 Bausch and Lomb Optical Company. Standard 
practice in the administration of the Bausch and 
Lomb occupational vision test with the Ortho-Rater, 
1944, pp. 1-5. 
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so that it is exactly even with the stationary 
gray. The right hand string pulls the mov- 
able object forward and the left hand string 
pulls it backwards. When you think the 
movable stimulus is exactly even with the 
stationary one, drop the s‘rings. You may 
move the right hand object back and forth 
as much as you want to. Keep your chin on 
the chin rest.” 

Experiments 1, 2, and 3. The first series 
was run with 40 Ss with 50-fc light, and with 
40 Ss with 12-fc light. In the second series 
there were 30 Ss who were used as both con- 
trol and experimental Ss with the 12-fc light 
first. The third series had 30 Ss used as both 
control and experimental Ss, but with the 50- 
fc light used first. 

Experiment 4. This experiment was car- 
ried out under the direction of the author by 
Mr. E. L. Franklin, a graduate student. 
There were 50 Ss and a 100-fc light was used 
in addition to the 12-fc and 50-fc lights. The 
order of lights was alternated. 


Results 


On the average it appears that depth per- 
ception is more accurate with the greater 
amount of illumination. But in the first 
three experiments, it is only in Experiment 1 
that this conclusion is substantiated by a 
critical ratio that indicated significance at 
the one per cent level. See Table 1. 

In Experiment 4, the averages are better as 
the light intensity increases. But only the 
difference between the 12-fc and the 100-fc 
lights gave a critical ratio that was signifi- 
cant at the one per cent level. See Table 2. 

Individual Results. It appears that some 
Ss are more accurate with less rather than 
with more light. In the first three experi- 
ments, the per cent of Ss who did better with 
12-fc than with 50-fc light were as follows: 
(a) Experiment 1, 25 per cent; (b) Experi- 
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Table 1 


Accuracy of Visua! Depth Perception with Two Intensities of Illumination 


Note: The standard (stationary) stimulus object was at 50 cm. on the scale. 





M cm. 


$2.47 
53.07 
55.71 


M shows the mean on the scale 


Table 2 


Accuracy of Visual Depth Perception with Three Intensities of Illumination 


Note: The standard stimulus was at 50 cm. and the M gives the average on this scale. 


50 fe 


M cm. S.D. 
50 (1) 56.6 1.92 


C.R.: 1-2 = 0.93; 1-3 = 2.29 (5%); 


ment 2, 30 per cent; and (c) Experiment 3, 
20 per cent. 

In Experiment 4, which used three intensi- 
ties of light, the per cent of judgments that 
were better with the light of less intensity 
are as follows: (a) 20 per cent better with 
12 fc than with 100 fc; (b) 20 per cent better 
with 50 fc than with 100 fc; and (c) 22 per 
cent better with 12 fc than with 50 fe. 

In our four experiments, it thus appears 
that a considerable number of Ss judge depth 
better with less rather than with greater in- 
tensities of light. 


12 fc 100 fe 
Mcm. S.D. 


(2) 56.9 1.4 


M cm 


(3) 55.5 


2-3 = 3.18 (1%). 


Summary 


1. In terms of averages alone, it appears 
that Ss were more accurate in depth percep- 
tion with greater illumination rather than 
with less. 

2. Analyses of our data, however, show 
that from one-fifth to one-fourth of our Ss 
were more accurate with less rather than with 
more intense illumination. 

3. It appeared that no one intensity of 
illumination was optimal for all Ss. 


Received November 3, 1952. 
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Instrument Reading III: Check Reading of Instrument Groups 


W. J. White, M. J. Warrick, and W. F. Grether 


Psychology Branch, Aero Medical Laboratory, Wright Air Development Center, 
Wright-Patterson Air Force Base, Ohio 


Most previous studies (1, 3) of instrument 
reading have been concerned solely with pre- 
cise quantitative readings. However, it has 
been pointed out by Grether (2) that there 
are many situations where instruments are 
read only to obtain assurance of a null, nor- 
mal or desired indication (check reading), or 
for an indication of the direction in which an 
instrument pointer deviates from a desired 
value or position (qualitative reading). Mil- 
ton, Jones, and Fitts (4) report that the aver- 
age duration of the visual fixations of a pilot 
flying on instruments is approximately 0.5 
seconds. This suggests that aircraft instru- 
ments are typically read in a check reading 
manner. 

This paper summarizes a series of experi- 
ments concerning the effect of variation in 
pointer alignment position, in dial diameter 
and in pointer design on check and qualita- 
tive reading of instrument groups. For more 
detailed reports of these experiments, the 
reader is referred to a USAF Memorandum 
Report by Warrick and Grether (6) and two 
USAF Technical Reports by White (7, 8). 


Experiment I: Effect of Pointer Alignment 
Position on Check and Qualitative 
Reading 


A series of studies was carried out to de- 
termine the effect of various pointer-align- 
ment positions on the speed and accuracy of 
check and qualitative reading of a four by 
four arrangement of 16 instruments as shown 
in the center panel of Figure 1. In addition 
to alignment at the 9, 12, 3 and 6 o’clock po- 
sitions, several mixed alignment positions were 
studied. 


Apparatus and Procedure. The simulated panel 
of 16 instruments was presented by means of 
projected lantern slides. By the operation of a 
shutter device the subject controlled the exposure 
of the projected instruments. For the check 
reading tests, the subject responded by operating 
a three-position toggle switch held in his lap. 
He was instructed to move the switch to the 


right if all pointers were aligned, and to the left 
if any pointers were misaligned. Forty college 
students were used as subjects in this experiment. 

A somewhat more complicated response was 
required in the measurement of qualitative read- 
ing performance. To the right of the subject 
was a group of 16 three-position toggle switches 
arranged in the same manner as the 16 simulated 
instruments. If there was a deviating pointer 
the subject moved the corresponding switch in a 
direction to indicate an increase or decrease from 
the alignment position. Forty aviation cadets 
and forty experienced instrument pilots were 
used in the experiment. Each of the eighty sub- 
jects served under only one condition of pointer 
alignment. 

The apparatus and procedure used in studying 
mixed alignment differed from that described 
above. The stimulus material was an actual 
mock-up of 16 pointers and dials. Only the 9, 
12 and 3 o’clock alignment positions were studied. 
All pointers in any one row deviated by the same 
amount from the alignment position, the amount 
of deviation varying between rows. The ex- 
posure shutter was operated by the experimenter, 
who also set the pointers from the rear of the 
panel. Twelve subjects, staff members of the 
Aero Medical Laboratory, were used in this ex- 
periment, each subject serving under all experi- 
mental conditions. 


Results 


The results for the check reading study, 
Table 1, show that the time taken for check 
reading appears to be relatively independent 
of the orientation of the pointer. The aver- 


Table 1 
Speed and Accuracy of Check Reading a Group 


of 16 Instruments with Homogeneous 
Pointer Alignment 


Note: N = 40 (10 subjects in each group). 


Per Cent of 
Responses 
in Error 


Mean Response 

Pointer Time in 
Position 

9 o’clock ’ 2.0 

12 o'clock y 2.5 

3 o'clock y 5.0 

6 o'clock . 3.0 
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Table 2 


Speed and Accuracy of Check Reading 16 Instruments 
with Pointers Aligned Diagonally Around 
the 9, 12 and 3 o’clock Positions 
Note: N = 12. 


Per Cent of 
Res onses 
in Error 
18.8 
15.6 
10.6 


Mean Response 
Time in 
Seconds 

1.64 
1.56 
1.59 


Pointer 

Position 

9 o’clock 
12 o’clock 
3 o'clock 





age times required to scan the panel and op- 
erate the lap-held switch were 0.66, 0.69, 0.68 
and 0.63 seconds for the pointers in the 9, 12, 
3 and 6 o'clock positions respectively. Error 
frequency likewise did not discriminate be- 
tween the 9, 12, 3 and 6 o'clock alignment 
positions. With mixed alignment the response 
times were more than doubled and the fre- 
quency of errors was generally higher as 
shown in Table 2. 

For qualitative reading, the exposure and 
response time data in Table 3 show that align- 
ment at the 9 o'clock position resulted in more 
rapid reading ef the group of 16 instruments 
than did alignment at the 12, 3 or 6 o’clock 
positions. A comparison of the error data 
shows that the readings at the 9 o’clock align- 
ment position were also more accurate. The 
results are similar for both pilots and cadets. 
Mixed alignment conditions caused a consid- 
erable increase in response time and errors as 
shown in Table 4. 


Discussion 


The apparent superiority of pointer align- 
ment at the 9 o’clock position over the other 
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cardinal positions for qualitative reading may 
have resulted from the relationship between 
the direction of the required switch response 
and the direction of the pointer deviation. 
The instructions to the subject read in part, 
“. . . if the reading is too much, flip the 
switch down, . . . if the reading is too little, 
flip the switch up. ...° The direction of 
the deviation which corresponds to a judg- 
ment of ‘too little’ or “too much” changes 
with alignment position. Apparently the re- 
lationship inherent in the 9 o’clock position 
was optimal under these instructions. 

The results of the experiment on check 
reading did not indicate the superiority of any 
one of the four alignment positions. They 
did demonstrate, however, that pointer align- 
ment, particularly uniform pointer alignment, 
greatly simplifies the task of reading a group 
of instruments. The response times found in 
this experiment using 16 instruments are ap- 
proximately equal to the time required for 
reading a single instrument in flight. 


Experiment II: Effect of Pointer Design 
on Check Reading 


The purpose of this experiment was to de- 
termine the effect of certain factors in the de- 
sign of pointers on the speed and accuracy of 
check reading a group of 16 instruments with 
horizontal pointer alignment. The superiority 
of pointer alignment for rapid check reading 
apparently results from the simple pattern 
which is disturbed by any deviating pointer. 
Any malfunction which would cause the pointer 
to rotate 180 degrees might not be detected 
because of the minor resultant change in the 
general alignment pattern. Variations in the 


Table 3 


Speed and Accuracy of Qualitative Reading of Sixteen Instruments with Homogeneous Pointer Alignment 


Note: N = 48 (12 subjects in each group). 





Mean Exposure Time 

in Seconds 
Pilots Cadets 
0.90 
1.15 
1.30 
1.62 


Pointer 
Position 


1.17 
1.39 
1.83 


9 o'clock 
12 o’clock 
3 o'clock 
6 o'clock 


Mean Response Time 
in Seconds 


Pilots Cadets 
1.63 
2.02 
2.32 


Per Cent of Responses 
in Error 


Pilots 


2.91 
6.25 
23.33 
10.83 


Cadets 
5.00 

12.08 

20.83 
9.58 
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Table 4 


Speed and Accuracy of Qualitative Reading 16 Instru- 
ments with Pointers Aligned Diagonally Around 
the 9, 12 and 3 o’clock Positions 

Note: N = 12. 


Per Cent of 
Responses 
in Error 


Mean Response 
Time in 
Seconds 


Pointer 
Position 
9 o'clock 4.51 
12 o'clock 4.36 
3 o'clock 4.78 


15.8 
22.6 
14.9 


design of the base of the experimental point- 
ers in the present study were intended to in- 
crease the change in pattern resulting from a 
180-degree deviation. 


Apparatus and Procedure. The stimulus mate- 
rial and method of presentation and procedures 
were very similar to those used in the preceding 
experiments in this report. The five pointer de- 
signs studied in this experiment are shown in Fig- 
ure 1. All pointers had about the same physical 
dimensions. They were 14" long and 342" wide 
at the center. Five film strips, one for each 


Fic. 1. 


pointer design, were made of a panel containing 
16 simulated 14” instruments. 

Forty instrument pilots and an equal number of 
cadets served as subjects: each served under only 
one condition of pointer design 


Results 


The results in terms of speed and accuracy 
of check reading as a function of pointer de- 
sign are summarized in Table 5. In the first 
two columns of this table are the per cent of 
readings in error, all errors being combined 
for pilots and cadets. In the next two col- 
umns are the per cent of undetected 180- 
degree deviations. For both subject groups 
the number of undetected deviations was 
greatest for design D. For the pilot group 
only the largest difference, that between de- 
signs D and E, is significant at the 5°% level 
of confidence. For the cadet group none of 
the differences are significant at the 5°% level 
of confidence. This suggests that the experi- 
mental pointers (designs A, B, C and E), 


when rotated 180 degrees from alignment po- 
sition, were little if any more effective in pro- 


Instrument panel arrangement used in all check reading experiments and pointer 


designs used in Experiment II. 
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Table 5 


The Effect of Pointer Design on the Speed and Accuracy of Check Reading 16 Instruments 
with Homogeneous Pointer Alignment 
Note: N = 90 (10 subjects in each sub-group). 





Per Cent of Readings 
in Error 
(N = 200 Trials) 
Pointer — ——— 


Design Cadets 


14.00 11.00 
16.50 10.50 
15.50 15.5 
14.50 12.5 


Pilots 


Per Cent of Undetected 
180° Deviations 
(N = 40 Trials) 


Pilots Cadets 
45.00 37.50 
47.50 35.00 
47.50 27.50 
62.50 47.50 


Mean Re 
sponse Time 
in Seconds 


Per Cent Misc. 
Errors 
(N = 160 Trials) 
Pilots Cadets Pilots Cadets 
6.25 4.37 2.00 2.11 
8.75 4.37 1.62 1.91 
50 12.50 1.80 2.05 


50 4.37 1.75 1.90 


21.50 39.00 


viding cues for detection of misalignment than 
was the standard pointer (design D). 

If we compare the data for miscellaneous 
errors in Table 5, a somewhat different pic- 
ture is obtained. For the pilot group the error 
percentage was lower for the standard pointer, 
design D, than for other designs with the dif- 
ferences significant at the 5‘7 or greater level 
of confidence. The results for the cadet group 
do not support this superiority of the design 
D. The mean response time values in the 
last two columns of Table 5 show no signifi- 
cant differences between pointer designs. 


Discussion 
The failure of the experimental pointers to 
reduce substantially the 180-degree type error 
may, perhaps, be attributed to a configura- 
tional change brought about when the pointer 
overlays the dial numerals and graduations. 
This reduces the visibility of the expansions 


16.00 2.80 


of the pointer base. This is especially likely 
when the panel is scanned rapidly as in check 
reading. 


Experiment III: Ocular Movements in 
Relation to Dial Diameter 

The pioneering work of Paterson and Tinker 
(5) on typographical factors which influence 
reading suggests that there might be an opti- 
mal dial diameter for instrument reading pur- 
poses. The optimal dial diameter should be 
such that the resulting instrument panel size 
could be scanned accurately, rapidly and with 
a minimum number of eye fixations. The 
most suitable approach to this problem ap- 
peared to be through the combined measure- 
ments of manual responses and of eye move- 
ments while check reading a panel of instru- 
ments. 


Apparatus and Procedure. 
three panels were used. 


For this experiment 
The instrument diame- 


Table 6 


Eye Movements, Response Times and Errors in Check Reading a Group of 16 Instruments 


Note: N = 6. 


Type of Measure 


Mean number of fixations per trial 
Mean time per fixation 


Total scanning time from preliminary to final fixation 


Dial Diameter 


1} inches 2} inches 
2.8 2.6 2.9 
0.29 0.26 0.26 


0.82 0.72 0.75 


1 inch 


Per cent deviating pointer trials on which deviating pointer 


was fixated 
Response time (sec.) 
Per cent errors 


72 71 
0.76 0.72 
6 4 
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Distribution of first, second and third eye fixations in check reading a 


panel of 16 instruments. 


ters were 1, 14, and 2% inches. In all cases the 
spaces betweep the margins of the instrument 
were %& inch. These panels were check read 
using both eyes. The movements of the right 
eye were recorded by the corneal reflection tech- 
nique. An American Optical Company Ophthal- 
mograph was modified so that exposures could be 
made with either moving or stationary film. The 
moving film exposures provided data on the num- 
ber of fixations, and the lateral position and dura- 
tion of fixations. The stationary film exposures 
provided additional data on the position of fixa- 
tion in both the vertical and lateral dimensions, 
but did not record the duration of fixations. 

On each of 60 test trials the subject was re- 
quired to fixate a spot to the left of a screen 
covering the panel. When the screen was raised 
the subject scanned the panel as needed and then 
fixated on a spot to the right of the screen. He 
then signalled his judgyusent as to whether or not 
a pointer was deviated from the aligned position. 
For three of the six subjects the initial and final 
fixation points were reversed. When the film 
record of the subject’s eye movements was pro- 
jected against a replica of the corresponding in- 
strument panel, the initial and final fixation points 
provided references for the analysis of the film 
records. 


Results 


The major results obtained from the re- 
cording of eye movements are summarized in 
Table 6, which gives check reading time, re- 
sponse time and error data in addition to the 
vatious measures of visual performance. Al- 
though not statistically significant, the re- 
sults are quite consistent in showing slightly 
superior performance with the 14-inch dial 
size. 

Analysis of the location of the Ist, 2nd and 
3rd fixations, in relation to the panel arrange- 


ment, are shown in Figure 2. The major pro- 
portion of the first fixations were in the upper 
left quadrant of the instrument panel. This 
was true even when the preparatory fixation 
was at the right of the panel. Surprisingly 
few fixations were made on the lower two 
rows of dials, and those that did fall in this 
area were usually the last fixation in the scan- 
ning sequence. Analysis of the errors com- 
mitted shows that 22 per cent more errors 
were made when the deviating pointer was in 
the lower half of the panel. In the fourth 
row of Table 6 is shown the per cent of devi- 
ating pointer trials in which the deviating in- 
strument was fixated. 


Conclusions 


The following conclusions are suggested by 
the results of the foregoing experiments: 

1. The pointer alignment position (9, 12. 
3 or 6 o’clock) has little effect on simple check 
reading involving the mere detection of a 
pointer deviation. 

2. Uniform horizontal or vertical pointer 
alignment facilitates instrument check read- 
ing. 

3. Pointer alignment at the 9 o'clock po- 
sition is optimum for qualitative reading as 
defined by the perceptual judgments and 
manual responses required in these experi- 
ments. 

4. Pointer modifications of the type em- 
ployed in the present experiment do not ac- 
complish a satisfactory reduction in difficulty 
of detecting 180-degree deviation errors. 
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5. A 1%4-inch instrument dial appears su- 
perior to either a larger or smaller dial in 
terms of the number and duration of eve fixa- 
tions while check reading. 


Received August 25, 1952. 
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Dimensional Analysis of Motion: VI. The Component 
Movements of Assembly Motions ' 


Robert Smader and Karl U. Smith 


The University of Wisconsin 


The application of electronic methods to in- 
vestigation of human motions (1, 4, 5) pro- 
vides the means of systematic experimental 
study of long-standing problems of motor co- 
ordination. Such electronic techniques, which 
have been used previously in studying panel- 
control operations and closely related per- 
formances, are used in this study to analyze 
the component movements in assembly mo- 
tions. Data are presented bearing upon the 
relative efficiency of the component move- 
ments of assembly motions and upon the ef- 
fects of practice on such movements. 

Two methodologica! principles are demanded 
for the scientific investigation of complex hu- 
man motions. First, the basic dimensions of 
motion must be subject to control and quanti- 
tative specification. Second, the component 
movements of the pattern must be segregated 
and measured separately. This second re- 
quirement for motion study must be achieved 
with an economy sufficient to permit replica- 
tion of the observation of the same motion 
pattern throughout the course of an experi- 
ment. . 

Control and specification of the various di- 
mensions of movement, especially the bodily 
and space dimensions of movement, are se- 
cured through preplanning of performance 
situations in order to permit quantitative 
variation in the direction, plane, magnitude, 
bodily orientation, and other aspects of mo- 
tion. Measurement of the component move- 
ments in assembly motions may be achieved 
by means of electronic motion analysis tech- 
niques, to be described, which provide; for the 
first time, methods adequate for the experi- 
mental analysis of the separate movements of 
skilled performances. 


1 This research has been supported by funds voted 
by the Legislature of the State of Wisconsin, and as- 
signed by the Graduate School Research Committee, 
the University of Wisconsin. 


Methods 


Figure 1A illustrates the main parts of the ap- 
paratus used for electronic registration of the 
duration of the component movements in assem- 
bly motions. The task performed by the subject 
in this situation, as illustrated by Figure 1B, con- 
sists of four major movement components: (a) 
an initial reaching or travel movement that car- 
ries the hand and arm to the bins containing pins 
used as assembly objects; (b) a grasping move- 
ment in securing one of the pins; (c) a return or 
loaded travel movement that carries the pin to 
the assembly plate; and (d) a positioning mo- 
tion of inserting the pin in the assembly plate. 

The preplanned performance situation used 
here is designed to provide for systematic varia- 
tion in different space dimensions of component 
movements of the assembly task (Figure 1B). 
Assembly bins and the assembly plate are ar- 
ranged generally on a work table measuring 35 in. 
by 20 in. The ‘metallic assembly bins, which are 
fitted with metal bases, are 8 in. long, 4 in. wide, 
and 4 in. high. The floor or base of each bin is 
curved to facilitate grasping of the pins located 
inside. Six such bins may be used for pins or 
collars of different sizes. The distance and ar- 
rangement of these bins with respect to the as- 
sembly plate may be changed to vary the magni- 
tude, direction and plane of component travel 
and grasping movements. 

The assembly plate (Figure 1B) is of aluminum 
% in. thick, 1044 in. long and 1014 in. wide, drilled 
with 16 large apertures, 1516 cm. in diameter. 
Fitted into these apertures are discs which are 
drilled with three holes of different sizes, i.e., 
% in., 38 in. and % in. The discs may be locked 
into three different positions on the assembly 
plate. Three sizes of pins, all approximately one 
inch long but of diameters to fit the three sizes 
of holes, are provided in three bins. Variations 
in size of object grasped, serial order of place- 
ment of the pins, and other variations in the di- 
mensional aspects of the assembly placing move- 
ment are made by means of the different place- 
ments of the bins and positions of the holes on 
the assembly plate. 

The subject’s movements in this situation are 
recorded by means of an electronic motion ana- 
lyzer that automatically segregates and measures 
separately in 0.01 seconds the duration of each 
of the four basic component movements in the 
task. Figure 1A illustrates how the clocks and 
circuits of the analyzer are arranged with respect 
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Fic. 1. A diagrams the general layout of the motion analyzer circuits, the time clocks, 
the assembly plate, and the bins. The bins are made with curved bottoms in order to 
facilitate removal of the pins. B shows the surface detail of this same setup. The letters 
“LH.” and “R.H.” in this diagram refer to left hand and right hand respectively. The 
sequence of movement with the right hand is indicated by number. The size of pins lo- 
cated in the bins is indicated in rejatien to the position of the bin, 
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to the work area. The basic principle of opera- 
tion of the electronic analyzer is that the subject 
acts as a key in the circuit and thus sequentially 
activates different relays and clocks * during the 
different stages of the assembly motion. The 
current level used in the subject’s side of the cir- 
cuit is below cutaneous threshold level, so that 
the operator has no sensory appreciation of the 
fact that he is serving as a conductor. 

Figure 1B shows how the device performs in 
actual operation. Upon starting a cycle of as- 
sembly motion, the subject initially touches the 
assembly plate. -This contact with the plate starts 
the first of the four precision time-clocks, the 
initial travel time-clock. Upon coming into con- 
tact with the pins in one of the assembly bins, 
this first clock stops and the second, the grasping 
time-clock, starts. When the contact between 
the pin and the bin is broken, the grasping time- 
clock ceases to run and the loaded-travel time- 
clock starts to run. This third clock stops when 
the pin is brought into contact with the assembly 
plate, and the fourth clock, the assembly posi- 
tioning time-clock, starts to run. This fourth 


2Model S-1, Standard Electric Time Company, 
Springfield, Mass. 
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clock in turn stops running when electrical con- 
tact with the assembly plate is broken and a 
second cycle of motion is initiated. The differ- 
ent times registered on each clock may be read 
after one cycle of motion or they may be al- 
lowed to summate over several cycles and then 
be read 

In the experiment to be described, 46 right- 
handed college students were used as subjects. 
These subjects were given standard instructions 
to fill the assembly plate with pins according to 
a defined sequence, which was kept constant for 
all subjects. One complete filling of the plate 
constituted a trial. Subjects performed two trials 
per day for each of three consecutive days. All 
scores analyzed were the mean durations of each 
component movement for each day. 

In addition to the running of the test trials, as 
just described, a calibration trial was run before 
the first test trial of the second and third days. 
In these calibration trials, the two manipulation 
time clocks and the two travel time clocks were 
electrically connected so that the discrepancy be- 
tween two clocks in measuring the same elapsed 
time could be determined. 
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Distribution of the durations of different component movements in re- 


lation to subjects. The figures for the manipulative components are given to the 
left and those for the travel components to the right. 
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The change in the duration (A) and in the variability (B) of the four different component move 
Generally, the two travel movements show 


less change with practice 


than that observed in the grasping and positioning movements 


Results 


The results of this experiment will be pre- 
sented with respect to the following main 
points: (1) distribution of time values for 
different component movements in the assem- 
bly task; (2) the effects of practice on dif- 
ferent component movements in the task as 
well as on their interrelation; and (3) the 
reliability of measurements of different move- 
ment components. 

Figure 2 shows the distribution of move- 
ment times of the four component movements 
of the assembly task on the third day of prac- 
tice. The data presented in this figure repre- 
sent the durations of individual movements 
for each part of the assembly task. The 
movement component giving the shortest 
times is the grasping movement. The as- 
sembly positioning movement gives the long- 
est durations. All four movement components 
show distributions that are slightly skewed 
positively. 


Figures 3A and 38 describe the change in 
the duration of the component movements of 
the assembly task as a function of practice. 
Figure 3A gives the learning curves based on 
the mean duration of each of the component 
movements on each day. Figure 3B shows 
the change in variability of each component 
movement as a function of practice. 

Three of the four movement components in 
the task show a highly significant change in 
duration as a result of practice over three 
days. The greatest change, about 18 per 
cent, is found for the grasping component of 
the task. The other manipulative component 
of the task, the positioning movement, gives 
an 11 per cent change with practice. Both 
of these manipulations show a greater change 
with practice than does either of the travel 
movements. One of the latter, the unloaded 
travel movement, shows a statistically signifi- 
cant change with practice only at the 0.05 
point. Tests of significance of the differences 
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between day | and day 3, based on “t,”’ indi- 
cate that changes occurring in learning for 
the three other components of movement are 
significant at the 0.001 point. On each day 
of practice, the differences between the mean 
durations of the two manipulative compo- 
nents, grasping and positioning, and between 
the two travel movements are statistically 
significant at the 0.001 level. 

The variability of different component 
movements does not change uniformly as a 
function of practice. The variability of the 
unloaded travel movement decreases with 
practice, but not significantly. In contrast, 
the variability of the grasping motion is 
reduced sharply with practice. The other 
manipulative movement, positioning, has its 
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standard deviation changed about 15 per cent 
with practice. The variability of the loaded 
travel movement is hardly changed at all 
during the three days. 

The present method of isolating electron- 
ically the different components of movement 
in assembly has provided the means of study- 
ing the interrelation between separate move- 
ments as a function of practice. In order to 
conduct such investigations, the individual 
mean scores for each component of motion 
are obtained for each day of practice and cor- 
related. Thus, six correlations between pairs 
of the four component scores are obtained for 
each day of the study. 

The correlation values just described are 
plotted in Figure 4 as a function of days of 
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The level of correlation between different component movements during practice. 


The plot to 


the left gives the curves for pairs of movements that are adjacent to one another in the motion pattern. 
The plot to the right gives the curves for pairs of movements that are non-adjacent in the cycle. The 


correlation values at the .05 and .01 points are 


indicated by the dotted lines 


Among the different 


curves, only those for the correlations between loaded and nonloaded travel and between positioning and non- 
loaded travel are statistically significant for all three days of practice, 





Dimensional Analysis of Motion: V1 


Table 1 
Coefficients of Stability of the Component 


Movement Times 


Day 1 vs. 
Day 2 


Day 2 vs. 
Day 3 


Test-retest Test-retest 
Reliability Reliability 
Component Coefficient Coefficient 


Position 


Type of 
Component 


+0.79 
+0.79 


+-0.86 


Manipulative +0.91 


Grasp 


+-0.83 
+0.80 


Unloaded +0.88 


+0.91 


Travel 
; Loaded 


practice. In addition, the broken lines on 
Figure 4 indicate the 5% and 1% levels at 
which these correlations may be considered to 
differ significantly from zero. The correlation 
functions which give values consistently sig- 
nificant at the 5‘ level are those represent- 
ing the relations between loaded and unloaded 
travel movements and between position and 
unloaded travel movements. Although it 
might be expected that the position and grasp 
movements would correlate highly with one 
another, these two movements in fact show 
no significant relation with one another. 
The main point to be observed in Figure 4 
is the change in the correlation between com- 
ponent movements in relation to practice pe- 
riod. It will be observed that none of the 
correlations between different pairs of move- 
ments is significantly altered during the three 
days of practice. In other words, the inter- 
relation of movement components does not 
vary during learning and improvement in per- 
formance in the over-all task. If the correla- 
tion between component movements is thought 
of as a measure of integration between these 
movements, then the results show that learn- 
ing has little or no effect on the integration 
of separate movements in assembly motions. 
Inasmuch as the present experimental tech- 
niques represent quite complex procedures for 
automatic measurement of behavior, it is of 
importance to examine the temporal consist- 
ency of scores obtained. It will be remem- 
bered that each subject performed two trials 
on each of the three days of practice, and 
that four scores, representing different com- 
ponent movements, were obtained on each 
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trial. To obtain correlation coefficients be- 
tween days for each of the four component 
movements in the task, a mean score for each 
subject for each type of movement was ob- 
tained and these values for different days 
were then correlated with one another. Ta- 
ble 1 summarizes the values obtained. The 
table shows that a high degree of consistency 
is found for the component movement times 
in the assembly task. It should be noted 
again that the figures given in Table | are 
based upon only two trials of performance 
per day and that the figures represent consist- 
ency between days. These figures in Table 1 
show that the low intercorrelations between 
component movements, as given in Figure 4, 
cannot be accounted for in terms of unre- 
liability of the individual movement times. 


Summary 


This study describes electronic techniques 
which make possible detailed experimental 
study of the component movements in assem- 
bly motions. Besides indicating the nature 
and value of these methods for analysis of in- 
dustrial motions, the present paper describes 
experimental results bearing upon the char- 
acteristics of component movements in an as- 
sembly task, and upon the effects of practice 
on the duration and relation between these 
movements. 

By means of the electronic techniques de- 
scribed, the component movements of travel, 
grasp, loaded travel and positioning in a uni- 
manual assembly task may be isolated and 
their durations measured in hundredths of 
seconds. Distributions of the component 
movement times for forty-six college student 
operators are approximately normal. 

Practice does not affect uniformly different 
types of movement in the assembly task. The 
efficiency of the two manipulative movements, 
positioning and grasping, are changed the 
most by practice. In contrast, the travel mo- 
tions in the task, especially the unloaded 
travel component, show very little change 
with practice. Similar results are found for 
measures Of variability of response during 
practice. 

It has been observed also that practice does 
not alter significantly the correlation between 
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component movements in the assembly task. 
Early in learning the correlations between the 
different component movements of manipula- 
tion and travel are near zero. As practice 
continues, the values of these correlations do 
not change significantly. At the start of 
learning, a correlation of about +0.07 is 
found between the two travel movements in 
the task. With practice, this correlation in- 
creases slightly but not significantly. 

The results on the effects of practice, as 
just described, are equivalent to experimental 
lindings obtained in previous studies of learn- 
ing and component movements in tracking be- 
havior (2, 3) and panel control motions (1, 
4, 5, 6). In all of these tasks, the human 
body seems to act like a many-channeled sys- 
tem in the production of discrete unrelated 
movements for a given task, the integration 
of which is not altered materially by con- 
tinued practice. The findings described here, 
along with similar results found for other mo- 
tion patterns, point toward the lack of signifi- 
cance of learning concepts in understanding 
the details of movement coordination in skill. 
The same results, however, point up the great 
significance of component and dimensional 


motion analysis in dealing practically and 
theoretically with problems of skilled motion 
and the instrumental relations of such motion. 


The electronic methods of motion analysis 
described in this report provide, for the first 
time, economical methods of obtaining reliable 
measures of movement components in assem- 
bly skills. These methods, along with pro- 
cedures of preplanning and quantitative con- 
trol of the dimensions of motion in work, lay 
the foundation of scientific study of motion in 
terms of modern experimental designs. 
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The F minus K Index on the MMPI 


Angus G. MacLean, Arthur T. Tait, and Calvin D. Catterall 
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Hunt (2) compared F-K raw scores for 
honest and dissembled MMPI profiles from 
the same subjects and found that an F-K 
cutting score of — 11 and below was fairly 
effective in spotting fake-good cases, but also 
picked up too many supposedly honest cases. 
Gough (1) reported the distribution of F-K 
scores for a group of 691 adult normals, the 
middle 80°7 of whom obtained approximately 
normally distributed scores ranging from — 22 
to + 11 with a mean of about — 9. 

The present data consist of a sample of 100 
candidates for nursing randomly drawn from 
a large number of similar cases in the Los 
Angeles and San Francisco Metropolitan 
areas. These candidates are almost without 
exception female, are finishing the 12th grade 
or are in their first year of college; if not at- 
tending college, they range from 18 to 22 
vears of age with a modal age of 18 to 19. 
These cases provide data worth noting since 
they are in a selection situation; furthermore, 
the balance of their MMPI profiles suggests 
that they are motivated to present themselves 
in the best light. Few T-scores exceed 60 on 
any clinical scale and virtually none exceed 
70 

The F. K, and L scores for these subjects 
are distributed as follows: Actual distribution 
of F scores; T = 50: 64 cases; T = 53: 17 
cases; T = 55-59: 8 cases; T = 60-64: 10 
cases; and T = 73: 1 case. 

A mean and standard deviation should not 
be calculated for such a distribution. 

The distribution of K scores had a mean 
of 57.9 and a standard deviation of 8.5. The 
total range was from 30 to 79, and the middle 
80°* of cases lay between 46 and 69. 

The L scale had a mean of 72.0 and a 
standard deviation of 8.1. The total range 
was from 50 to 84, and the middle 80% of 
cases lay between 61 and 82. The scores were 
slightly negatively skewed, and it seems pos- 
sible that these candidates, while defensive on 
the F and K items, felt that frankness on the 


L items would not be damaging, or even 
that they might be “catch” items. 

The distribution of raw scores, somewhat 
smoothed, is shown in Table 1. 

It is suggested that a cutting score of — 17 
might be tentatively adopted: this would in- 
clude 31% of the nurse candidates but only 
about 12% of the “Adult Normal” cases dis- 
cussed by Gough. A cutting score of — 14 
would include 50% of nurse candidates and 


Table 1 
F-K Raw Score Distribution on MMPI Based on a 


Sample of 100 Candidates for Nursing 


Sten Score 
(1 sten= 
0.50) 


Raw Score 
(Low er 
Limits) 


t's 
% in 
Category Cumulative 
(Smoothed) a/// 
y 2 
8 2 
2 


5 up 2.3 
2 1.4 6.7 
0 9,2 15.9 
6 17 15.0 30.9 

14 19.1 

11 19.1 69.1 

9 15.0 84.1 
7 9.2 93.3 
2 4.4 97.7 
1, 0, of 3 100.0 


positive 


/ 


50.0 


about 22°% of Gough’s “Adult Normals.” It 
may be assumed, lacking information to the 
contrary, that the “Adult Normals” consisted 
merely of non-pathological cases, and included 
quite a wide range of cases from the moder- 
ately self-critical and fairly honest to the 
highly ego-defensive. About 1°% of Gough’s 
cases obtained F-K scores of 22 or more. 
Thus, if a cut-off is established at — 17, about 
12 or 15% of Gough’s cases will be included, 
it is true, but it may well be supposed that 
these cases are not so much unusually well- 
adjusted, as those with a tendency to dis- 
semble even in a non-selection situation. 

In view of the above data, the following 
ranges for the F«K index are suggested: 
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1. Positive Raw Score, especially if greater 
than + 2: malingerers or very self-criti- 
cal and unusually honest subjects. 

Raw Score from zero to — 10: Normal 
Area. 

. Raw Score from 
ful Area. 

. Negative Raw Score greater than — 17: 
Probable ““Fake-good” Area, especially 
when the F-K difference lies the 
twenties. 


— 11 to 16: Doubt- 


in 


Optimal cut, as always, refers to a specified 
pair of populations, and caution must be used 
in generalizing to dissimilar groups and situa- 
tions. For example, in another study we 
found the F-K raw-score difference to range 
from — 25 to + 30, with a middle-80% range 
from — 16 to +9, a mean of —5 anda 
median of — 6. The SD for this group is 


Tait, and Calvin D. Catterall 


approximately 10 raw-score points. We can 
only assume that some members of this group 
desired to appear in a good light, while others 
were either malingering or unusually self- 
critical. This would suggest regarding small 
positive scores as indicative of frankness and 
insight, while the suspicion of malingering 
would pertain to positive scores in the neigh- 
borhood of + 15 or more. 
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Accident Records of Commercial Truck Drivers * 
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This study is one phase of a larger over-all 
research project being carried out in the De- 
partment of Psychology at North Carolina 
State College, Raleigh. The general purpose 
is to improve the method of selecting truck 
drivers to be employed by a large East Coast 
trucking concern. 

Criterion data for studies such as this have 
long been a subject of controversy. Up to 
the present time the data used have been the 
accident records. The manner in which these 
data have been used has been varied, but no 
really “new” idea in criterion data has been 
devised. It is basically the accident record, 
therefore, which was used in this study, and 
the records for the various subjects were 
equated on the basis of the number of miles 
driven by each. 

The subjects were 104 drivers who were 
still employed by the company on a certain 
cut-off date, and who had been trained at the 
Driver Training School operated by the 
North Carolina State College. All subjects 
had been tested at the training school by 
an examiner trained in psychological testing, 
and under standardized conditions. In most 
cases the test results were not used in the 
employment procedure by the company. 
Some subjects did not have a complete re- 
port of their test performance in their files, 
and this necessitated using varying sample 
sizes for the different variables. 

The factors or variables with which the 
accident records are compared are divided 
into two categories: (a) psychological test 
data and (b) personal history data which 
were derived from the application blank filled 
out by the employee at the time of his em- 

* This study is a condensation of a thesis submitted 
to the North Carolina State College of Agriculture 
and Engineering of the University of North Caro- 
lina, Raleigh, in partial fulfillment of the require- 
ments for the degree of Master of Science in In 
dustrial Psychology. The author wishes to express 
appreciation to Dr. Dannie J. Moffie under whose 
direction this study evolved. 


Parker, Jr. 
Colle ge 


ployment by the company. The tests used 
were some of the better-known paper-pencil 
tests of intelligence, mechanical comprehen- 
sion, personality, and vocational interest. The 
results of visual screening with the Bausch 
and Lomb Ortho-Rater were also included. 
Personal history data included such things as 
age, education, marital status, blood pres- 
Sure, etc. 

Two sources were used to arrive at the cri- 
terion data: the number of accidents a man 
had incurred during a certain period of time, 
and the total number of actual miles driven 
during this same period of time. The acci- 
dent rate was then put on the basis of the 
number of accidents per 5,000 miles. This 
was done for two types of accidents, those 
classified preventable and non-preventable by 
the safety department of the trucking com- 
pany. 

Procedure 


The distributions of scores for the entire 
sample of 104 drivers on the psychological 
test data and the personal history data were 
divided into two groups, accident group and 
non-accident group, with respect to each of 
the two criteria, preventable and non-pre- 
ventable accidents per 5,000 miles. The acci- 
dent group for each of the criteria was fur- 
ther divided into upper and lower halves, ex- 
cluding the accident-free group. Figures 1 
and 2 show the distributions of preventable 
and non-preventable accidents. 
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“Student’s” ¢-ratio (2) was run between 
the means of the groups for each of the vari- 
ables as follows: between the accident and 
non-accident groups, and between the upper 
and lower halves of the accident group. 

The F-ratio test of differences was run be- 
tween the variances of the groups mentioned 
above, and in like manner. This was done in 
order to determine if the distributions being 
compared by means of the ¢-ratio had signifi- 
cantly different dispersion within the distribu- 
tions. In any analysis where the F-ratio was 
significant at the 5 per cent level of confi- 
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dence or better, and the significance level of 
the ¢-ratio was critical, the significance levels 
of the ¢-ratios were corrected for the differ- 
ence in variance (1). 

On the basis of the analysis for preventable 
accidents per 5,000 miles between the acci- 
dent and non-accident groups, those six vari- 
ables having the most significant ¢-ratio were 
chosen to be analyzed by the Wherry-Doo- 
little Shrunken Multiple Correlation Tech- 
nique (3). This type of analysis gives the 
maximum coefficient of correlation between 
the test variables and the criterion score after 
a correction has been made for the chance 
error added by each variable. The first step 
in this technique is the computation of inter- 
correlations among the variables included and 
the criterion (in this case, number of pre- 
ventable accidents per 5,000 miles). 


Results 


Tables 1 and 2 show the condensed results 
of the study (only those variables showing 
significance out of the total of 43 included 


Table 1 


Variables Showing Significant Differences ‘Between Upper Half, Accident Group 
and Lower Half, Accident Group 


Variable 





Systolic Blood Pressure 
Far Acuity, Right Eye 
Far Acuity, Left Eye 
Near Acuity, Left Eye 
Kuder Mechanical Interest 
MMPI Hypomania 

Far Vertical Phoria 

Near Acuity, Both Eyes 
Kuder Artistic Interest 
Kuder Literary Interest 


Preventable accidents 


t Difference in favor ot 


2.397* 
2.448* 
2.231* 
2.411* 
2.268* 
2.226* 
2.802** 
2.746** 
10.332°°* 
5.101" 


Lower half 
Lower half 
Lower half 
Lower half 
Lower half 
Lower halt 
Lower hali 
Lower half 
Upper half 
Upper half 





Non-preventable accidents 


Marital Status 

Far Acuity, Both Eyes 
Near Acuity, Both'Eyes 
Near Acuity, Right Eye 


= P < 0.05. 
= P < 0.01. 
P < 0.001. 


Lower half 
Lower half 
Lower half 
Lower half 





Data Related to Accident Records of Truck Drivers 


Table 2 


Variables Showing Significant Differences Between Accident Group and Non-accident Group 


Variable 


t Difference in favor of 





Preventable accidents 
2.011* 
2.136* 
2.358* 
2.649** 
3.404*** 


MMPI Hypochondriasis 
MMPI Masculinity 
Kuder Literary Interest 
MMPI Psychasthenia 
Kuder Artistic Interest 


Non-accident group 
Non-accident group 
Accident group 
Non-accident group 
\ccident group 





Non-preventable accidents 


Marital Status 
Depth Perception 


< 0.01. 


*=P < 0.05 * =P 
in the study are mentioned for the sake of 
brevity). In the tables, “difference in favor 
of” refers to which half of the sample dis- 
tribution has the higher mean score. With 
respect to Marital Status and Systolic Blood 
Pressure, higher score means that the driver is 
married and has higher systolic blood pres- 
sure than the mean for the sample. 

As a result of the Wherry-Doolittle 
Shrunken Multiple Correlation Analysis, it 
was found that only four of the six variables 
could be used to obtain the maximum multi- 
ple coefficient of correlation; these four were: 
Kuder Literary Interest, MMPI Hypochon- 
driasis, Masculinity, and Schizophrenia. The 
resulting multiple coefficient of correlation 
was 0.36. This coefficient is statistically sig- 
nificant at the 1 per cent level of confidence. 
The resulting prediction equation is: 


X,. = 0.00234834X3, — 0.00376978X 4» 
0.00183060X3,, + 0.00271910X3, 
+ 0.14349491]. 


In this equation the symbols have the fol- 
lowing meaning: 


X= the predicted criterion score, number 
of preventable accidents per 5,000 
miles 

the MMPI Hypochondriasis score 
X42 = the MMPI Schizophrenia score 

X39 = the MMPI Masculinity score 

X;,; = the Kuder Literary Interest score 


X55 


2.413* 
3.040** 


Non-accident group 
Non-accident group 


= P < 0.001 


The standard error of a predicted criterion 
score is 0.1007. 


Discussion 


The analysis indicates that the follow- 
ing variables—Systolic Blood Pressure; Far 
Acuity, Right Eye; Far Acuity, Left Eye; 
Kuder Mechanical Interest; MMPI Hypo- 
mania; Far Vertical Phoria; Near Acuity, 
Both Eyes; Kuder Artistic Interest; and 
Kuder Literary Interest—are related to pre- 
ventable accidents. That is, those drivers 
having high scores on all these variables, with 
the exception of Kuder Artistic and Literary 
Interests, tend to have a lower number of 
preventable accidents. Those drivers having 
high scores in Kuder Artistic and Literary 
Interests tend to have a higher number of 
preventable accidents. 

In looking at the analysis of the non-pre- 
ventable accident data, we see that the psy- 
chological test data variables have dropped 
out, and that only the following appear to be 
related to non-preventable accidents— Marital 
Status; Far Acuity, Both Eyes; Near Acuity, 
Both Eyes; Near Acuity, Right Eye; and 
Depth Perception. These all bear the same 
relationship to the non-preventable accident 
data; that is, the higher the score, the fewer 
the number of non-preventable accidents. 

It might be possible to postulate from the 
results of this study that one of the main dis- 
tinctions between preventable and non-pre- 
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ventable accidents is the fact that preventable 
accidents seem to be related to psychological 
test data. Similarly, it might be said that 
such sensory capacities as the visual skills 
and certain personal history data such as 
Marital Status seem to be related to non- 
preventable accidents. 

On the basis of the Shrunken Multiple Cor- 
relation Analysis, it was shown that by using 
the four variables—Kuder Literary Interest, 
MMPI Hypochondriasis, Masculinity, and 
Schizophrenia—a reasonably satisfactory pre- 
diction of the number of preventable accidents 
per 5,000 miles could be made. This part of 
the study seems to be quite significant. It 
would suggest that the psychological test 
variables, particularly those dealing with per- 
sonality traits, are the variables which con- 
tribute to the discovery of those drivers hav- 
ing a high preventable accident rate. It 
might be said that this would seem to bear 
out the results of the first part of the study. 

It should be mentioned that considerable 
selection has already taken place before these 
particular drivers are hired by the company. 
The mere fact that they attended the North 
Carolina State College Driver Training School 
makes them a select or special population, 
and therefore unlike what might be called 
representative of the general population of 
commercial truck drivers. We do not have 
any “extreme” cases in the sample, and it is 
these who seem to contribute a great deal to 
any analysis, especially one in which an at- 
tempt is being made to isolate variables which 
are contributing to job success. 

It must also be noted that the apparent sig- 
nificance of the ¢-ratios reported is inflated. 
This is due to the fact that those reported are 
selected from a total of 43 for each phase of 
the analysis of significance of differences. 


Summary and Conclusions 


This study has been concerned with study- 
ing the relationship of certain psychological 
and personal history data to the accident rec- 


. Parker, Jr. 


ords of a sample of commercial truck drivers. 
The accident data used were of two types— 
preventable accidents and non-preventable ac- 
cidents, and were equated for the number of 
miles driven. 

The subjects for the study were 104 com- 
mercial truck drivers employed by a large 
East Coast trucking concern. 

For each of the criterion groups two types 
of analyses were made: (a) the significance 
of differences between the upper and lower 
halves of the accident group was computed; 
and (b) the significance of differences be- 
tween the accident and non-accident group 
was computed. In addition, a Wherry-Doo- 
little Shrunken Multiple Coefficient of Cor- 
relation was computed for four of the vari- 
ables and the criterion score based on the 
first analysis of significance of differences. 

From this study the following conclusions 
can be drawn: 

1. A difference seems to exist between pre- 
ventable and non-preventable accidents. 

2. Psychological traits, as well as sensory 
capacities, are important in analyzing the 
accident liability for preventable accidents, 
while only personal history data and sensory 
capacities seem to be important in analyzing 
the accident liability for non-preventable ac- 
cidents. 

This study also demonstrated the appli- 
cability of a technique for controlling ex- 
posure to accident hazard; that is, using the 
number of accidents per unit mileage rather 
than just the total number of accidents. 
Received January 30, 1953. 
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Applied Psychology in Action 


A New Management Tool for 
Top Executives 


The first issue of Social Science Reporter 
appeared on April 15, 1953, and is to be 
issued semi-monthly. It is an effort to build 
a bridge of better understanding between so- 
cial scientists and the business leaders of 
America. The editor and publisher is Rex 
F. Harlow, 365 Guinda Street, Palo Alto, 
California, who wishes to be kept informed on 
the research that is being done. His staff will 
also seek to secure material for publication 
through personal interviews with scientists, 
the reading of scientific periodicals and at- 
tendance at scientific meetings. 

The first issue contained abstracts of ten 
research projects such as: management organi- 
zation and motivation (W. F. Whyte); man- 
agement and the individual in an organization 
(E. Wight Bakke); multi-relational socio- 
metric survey (I. R. Wechsler, R. Tanne- 
baum, and E. Talbot); administering changes 
(Harriet O. Ronker and P. R. Lawrence); 
executive retirement (H. R. Hall); manage- 
ment-employee communication (Nat. Soc. of 
Prof. Engineers); improving supervisors (N. 
F. Maier); pension-plan policies and practices 
(M. Puchek); changing attitudes (L. Fest- 
inger and H. Kelley); mass persuasion (D. 
Cartwright). 


Background of an Industrial 
Psychologist 


Excerpts from a letter and enclosure of per- 
sonal data may be of interest and value to all 
concerned with putting psychology to work in 
business and industry. After congratulating 
Dr. Marion A. Bills for her paper on “Our 
Expanding Responsibilities” and for develop- 
ing an Applied Psychology in Action section 
in the April, 1953 issue of the Journal of Ap- 
plied Psychology, Dr. John F. Michael wrote: 
“More than ten years ago I decided to be- 
come a psychologist with both feet solidly en- 
trenched in industry. Consequently I have 
had a series of jobs each selected with the 
criterion being the extent to which it would 


contribute to a comprehensive industrial and 
business background. The two page enclo- 
sure, which might interest you, described this 
experience in greater detail. 

“This attitude toward my professional re- 
lation to industry found great support in 
L. L. McQuitty’s article in American Psy- 
chologist of several years ago. He also felt 
the great need of first being in demand to 
business not solely because of one’s psycho- 
logical background but mainly because of 
one’s business background. The implications 
for the problem of communications are obvi- 
ous. This is notwithstanding the fact that 
one of our largest consulting firms in indus- 
trial psychology in selecting their own staff 
maintains they do not particularly consider 
any possible business experience of the psy- 
chologists they hire. 

“It seems fashionable to decry the small 
published output from psychologists spending 
all their time in industry. I fail to agree 
with the typical reasons offered by others for 
this. The main cause appears to me to be not 
any dire result of greater income, or any de- 
crease in the desire to contribute to the gen- 
eral advance of the field, but merely the re- 
sult of the lack of time and the need to sell to 
management the ‘problem’ of research. As a 
result it is almost impossible to do research 
as defined by other colleagues who have more 
time. An interesting support of this time fac 
tor might be the reading habits of the psy- 
chologist in industry. My own observation 
with reference to myself and others is that 
there is an inevitable decrease in professional 
reading from the dropping of the journal club 
subscriptions to the selection of a few jour- 
nals none of which are completely read. I 
feel that such a decrease has not taken place 
so widely among our academic colleagues. 

“The proposed feature is a most excellent 
suggestion. Comments to be accepted for 
publication should not be restricted too much 
with reference to content. Observations 
worthy of possible restatement into testable 
hypotheses, needs for specific techniques, 
notes as to application of psychological prin- 
ciples to unique problems in business are ex- 
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amples of possible contributions. In gen- 
eral, the basic characteristic should be brev- 
ity. This proposed section should give the 
psychologist in industry a voice by which to 
record some of his many varied actions which 
might be of interest and value to others. The 
thought of writing a comprehensive article 
likely has stifled the expression of many a 
good idea which, perhaps, would have re- 
quired only several short sentences anyway. 
These ideas should not be lost. 

“T fully realize nothing has been said to add 
any value or new points to Dr. Bills’ speech. 
It is just a case of my being very pleased 
with her excellent discussion of the psycholo- 
gist in industry with special reference to those 
of us who do not wear a tag which says ‘psy- 
chologist.’ ”’ 

Here are the high-lights of this industrial 
psychologist’s background and training: 

Age: 35; Education: AB, BS in LS, MA, 
and BBA, Western Reserve University; PhD, 
Ohio State University in 1952. Majors: 
Bibliographic research, general business ad- 
ministration, psychological aspects of market- 
ing and merchandising. 

Work History: (1) Business reference as- 


sistant, city public library, 3 years; (2) Re- 
search analyst, procurement division, Quar- 
termaster Depot, 3 years; (3) Market ana- 
lyst, for a large tire and rubber company, 3 
years; (4) Jobs in The Lincoln Electric Com- 
pany of Cleveland, Ohio, since January 1951: 
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automatic saw operator, plant layout de- 
tailer, assistant purchasing agent, factory en- 
gineer, management analyst, and at present 
management engineer. 

Professional Organizations: (1) American 
Psychological Association, Associate member 
since 1947; (2) American Marketing Associa- 
tion; (3) Cleveland Psychological Associa- 
tion; (4) Personnel Psychologists of Northern 
Ohio. 


Noise and Absenteeism 


A study reported by Dr. de Almeida is con- 
cerned with the maintenance of a work force 
of tabulating machine operators. He was 
called in because of absenteeism in a tabulat- 
ing department of 125 workers. Noise was 
found to be a real source of trouble. He 
found that this could lead to aural lesions and 
neuropathic troubles. He recommended a re- 
arrangement of equipment, placing machines 
on rubber supports, and “Cellotex’’ insula- 
tion of walls. These changes dropped the 
decibel average from 42 to 14. He states 
that 50 to 60 decibels, continued, causes 
permanent damage to the ear. Absences were 
reduced by 23 per cent, or 430 man/days in 
6 months.—-H. Ribeiro de Almeida, M.D. 
(Sao Paulo, Brazil). Influence of electric 
punch card machines on the human ear. 
Archives of Otolaryngology, 1950, 51, 215 
bee. 
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Heneman, H. G., Jr. and Turnbull, J. G. 
(Editors). Personnel administration and 
labor relations: a book of readings. New 
York: Prentice-Hall, Inc., 1952. Pp. xiv 
+ 434, $3.95. 


Pigors, P. and Myers, C. A. (Editors). Read- 
ings in personnel administration. New 
York: McGraw-Hill Book Company, Inc., 
1952. Pp. xii + 483. $4.50. 


Although not explicitly described as such, 
these two publications serve as supplementary 
reading sources for Yoder’s Personnel man- 
agement and industrial relations and Pigors 
and Myers’ Personnel administration, respec- 
tively. They reflect the same similarities and 
differences as the basic texts themselves. Both 
attempt to present selected readings dealing 
with the various aspects of the field, the for- 
mer stressing the “practical operating prob- 
lems that confront the personnel man, labor 
relations man, or union leader in everyday 
life” and the latter “the philosophy of per- 
sonnel administration, its basic problems and 
limitations, as well as criticisms and doubts 
raised by union leaders.” 

Heneman and Turnbull group their selec- 


tions under four parts: The Setting of In- 
dustrial Relations; Personnel Administration; 
Labor Relations; and Research and Evalua- 
tion. They present 170 readings in all, many 
of them not being the entire article but ex 
cerpts selected to deal specifically with the 


topic under consideration. This method of 
presenting readings has certain advantages 
and disadvantages. It reduces overlap and 
duplication of content but at the same time 
requires a clear over-all structure to tie the 
excerpts together. This the authors have at- 
tempted to provide by including introduc- 
tory statements before each part and by pre- 
senting a brief abstract, at the beginning of 
each chapter, of the main points of each 
reading and its contribution to the topic be- 
ing covered. Despite the editors’ care, some 
of the excerpts still “hang in mid-air” and 
the reader may feel a need for the omitted 
material which structured the original articles. 

In contrast, Pigors and Myers present only 
46 readings, organized under six parts: Na- 
ture and Scope of Personnel Administration; 
Analyzing and Handling Personnel Problems; 
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The Foreman; Building and Maintaining 
Work Teams; Wage and Work Assignments: 
and Employee Services and Programs. The 
individual readings tend to be longer and to 
be more self-contained (than those in Hene- 
man and Turnbull) and appear to be the com- 
plete original rather than excerpts. They also, 
however, are organized under sub-topics and 
each part includes an introductory statement, 
by the editors, which interprets the reading 
and shows its contribution to the topic being 
treated. 

It would be impossible to rate one of these 
publications as better than the other; they 
are just different. Although both provide 
adequate coverage of the general field and 
have eight authors in common, there is no 
selection which appears in both. Each has 
its favorite sources--Heneman and Turnbull 
the University of Minnesota Industrial Rela- 
tions Center, and Pigors and Myers the Har- 
vard Business Review—but both draw upon 
American Management Association publica 
tions, the Personnel Journal, recent books, 
and related fields. 

Both of these publications are worth being 
in the industrial psychologist’s library. They 
have a double value—for what is in them and 
for what is not. The readings themselves are 
drawn from a wide variety of sources and 
disciplines and indicate clearly that the indus- 
trial psychologist, to be truly effective and to 
be able to communicate with management, 
must become conversant with a wealth of 
literature outside of psychological journals. 
That psychologists are becoming recognized 
as contributors to the field is indicated by the 
fact that slightly over 10°7 of the authors in 
each book are psychologists. However, these 
are the psychologists who have written articles 
for the personnel journals or who have partici 
pated in conferences run by personnel man- 
agement groups. It seems clear that psy- 
chologists cannot be too modest and coyly 
wait for management to wade through psy- 
chological journals to find out what psycho! 
ogy has to offer. At any rate, only a very 
few of the readings in these two publications 
are taken from psychological journals 

It is also instructive to note in which areas 


authors from psychology are used. As one 
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might expect, Selection and Placement, Train- 
ing, and Research are those in which the psy- 
chologist is recognized as making the most 
unique contribution, but other areas are be- 
ginning to be influenced, areas such as mo- 
rale, safety, job analysis, and even adminis- 
tration. However, if these two publications 
are a guide, psychologists have still not made 
themselves felt as contributors to an under- 
standing of labor-management relation, incen- 
tive plans, union activities, grievances, disci- 
pline, etc. Either we have nothing useful to 
offer on these problems or have not made it 
readily available to nonpsychologists. I hope 
it is the latter. Albert S. Thompson 


Teachers College, 
Columbia University 


Walker, C. R. and Guest, R. HH. The Man on 
the assembly line. Cambridge, Massachu- 
setts: Harvard University Press, 1952. Pp. 
175. $3.25: 

The authors have contributed this pilot 
study in an effort to increase our general 
knowledge of the adjustments made and the 
satisfactions derived by workers on an as- 
sembly line. 


It is a thorough, well-organized inquiry into 
the expressed feelings and attitudes of these 
men regarding many facets of their work. 
The book describes in detail the work climate 
at Plant X which is an automobile assembly 


plant. The method of investigation was both 
qualitative and quantitative, giving a clear 
picture of attitudes toward seven character- 
istics of the work. These,-as listed by the 
authors, were: “the worker’s immediate job, 
his relations to fellow workers, pay and se- 
curity, his relation’ to supervision, general 
working conditions in the plant, promotion 
and transfer, and his relation to the union.” 
These attitudes were determined by inter- 
views, questionnaires, and the study of overt 
behavior. 

The results of this investigation are not 
new or startling. It is a typical study of atti- 
tudes of employees toward their work situa- 
tion, using the usual attitude research meth- 
odology showing us which aspects of the work 
were most liked and disliked. 

Unfortunately, the authors do not empha- 
size the main reason the employees liked their 
work. “Pay.” This criticism can be levelled 
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at many other social scientists of course. Per- 
haps it is because this aspect is considered out 
of their realm and they can’t do much about 
it. On the other hand, they have come up 
with some realistic suggestions for alleviating, 
at least in part, the main dislikes which these 
men expressed concerning their work which 
was the immediate job content. This further 
inquiry into the specific aspects of the job 
content itself which the men objected to is 
the only unique contribution of the book. 
Evidently, it was not hard work itself but the 
mechanical pacing and the repetitiveness of 
the job to which they objected most strenu- 
ously. Walker and Guest have proposed what 
appear to be practical suggestions for mini- 
mizing these objections. 

The essence of the problem seems to be 
that we have progressed too rapidly in the 
technique of mass production and it is time 
now to stop and re-organize our thinking to 
take into consideration the worker himself in 
order to solve some of the problems created. 
Many industrial engineers and members of 
plant management, however, are going to dis- 
agree until we can prove its economic effec- 
tiveness. John M. Cook 


Radio Corporation of America, 
RCA Victor Division, Camden, N. J. 


Laird, D. A. and Laird, Eleanor C. Practical 
sales psychology. New York: McGraw- 
Hill, 1952. Pp. xii, 291. $4.00. 

The formula adopted by the authors of this 
book is clear and easy to follow up to a point. 
Take self-administering tests of twelve to 
eighteen items each and label them self-suffi- 
ciency, dominance, self-confidence, social mix- 
ing, friendliness, hygienic habits, fatigue, tact- 
fulness, kindness, sympathy, warm-hearted- 
ness, optimism, ability to meet emergencies, 
considerateness, snobbishness, egotism, fault- 
finding, self-centeredness, and hot-tempered- 
ness. This will show the reader “where you 
stand in some qualities which are important 
for the salesperson” (p. 117). It will also 
help to convince him that scientific psychol- 
ogy underlies your approach. 

Sprinkle with authoritative statements such 
as: “About one person out of four has some 
characteristics which make him disagreeable” 
(p. 168). “Records show that graduates who 
received poor grades in college become as good 
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salesmen as those who had high grades” (p. 
12). “Psychological studies have shown that 
the love of selling or ‘sales drive’ is essential 
for sales success” (p. 13). “Ninety-eight per 
cent of experienced sales people like selling 
better than any job” (p. 15). 

Prove your points with “studies.” For ex- 
ample, if you want to demonstrate that love 
of selling can be developed, quote a study 
which shows that the longer men have been 
selling fire protection equipment the better 
they like it. Do not mention the possibility 
that self-selection rather than development 
accounts for the results. 

Lard with references to big names and 
stories of the Horatio Alger type. Mention 
N. W. Ayer, Marshall Field, John Wana- 
maker, Owen D. Young, Abraham Lincoln 
and Colonel Edward M. House. Tell how 
they succeeded. In the case of Colonel House 
quote him as saying, “Let the other fellow 
make the mistake first.” Point out that 


“House gained political power in the Wood- 
row Wilson administration by following that 
policy” (p. 264). 

Do not allow difficulties to disturb you. If 
the concept of the salesman implies a gener- 


ality which does not exist, if what is true of 
selling soap is not necessarily true of selling 
bonds, say so and then forget it. If the cri- 
terion of success in selling is so difficult to 
establish that it represents a major problem 
to psychologists in that field, don’t even say 
so. Ignore it. 

On the other hand, abash reviewers such as 
this one by writing with a style and clarity 
that far exceeds what your more conservative 
brethren produce. Demonstrate that you have 
absorbed the best of the common-sense stereo- 
types about the sales situation and that you 
have a rare gift for organization and empha- 
sis. Beat all of the “Sales Power in Five Easy 
Lessons” boys at their own game. Convince 
even the psychologists that, after all, sales- 
men are probably better off to read your book 
than most of the literature that is now given 
them. 

But do not say that “The first attempts to 
teach something about human nature in re- 
lation to the customer produced a lot of 
plausible-sounding nonsense. Magazines and 
books were filled with ‘how to sell’ advice 
which made psychologists, who knew human 


nature, laugh aloud” (p. 38). Waho’s laugh- 
ing? S. Rains Wallace, jr 
Life Insurance Agency Management Association, 
Hartford, Connecticut 


New York: 
1952. Pp. 


Barlow, F. Mental prodigies. 
Philosophical Library, 
$4.75. 

This book is described on its title page as 
“An enquiry into the faculties of arithmetical, 
chess and musical prodigies, famous memo- 
rizers, precocious children and the like, with 
numerous examples of ‘lightning’ calculators 
and mental magic.’”’ Actually most of it is 
devoted to lightning calculators and to ex- 
amples of the mathematical tricks, stunts 
and problem solving used in performances 
of “mental magic.” The author is himself 
something of a ‘mathemagician,’ having 
given performances using his own mnemonic 
devices and calculating short-cuts. His in 
terest in such matters dates back to the nine- 
teen-twenties or earlier and has led him to in- 
terview several arithmetical prodigies. For 
the most part, however, his knowledge of 
prodigies is second or third hand. 

The first chapter, 58 pages in length, is an 
interesting account of nineteen outstanding 
arithmetical prodigies of the last two and a 
half centuries, together with brief notes on 
twenty-two others less well known. The 
large majority of both groups were born be- 
tween 1700 and 1870, and only seven of them 
since 1900. For the outstanding cases the 
author gives where possible date of birth and 
of death, nationality, age when the special 
gift became evident, amount of education, ex- 
amples of calculating feats performed, and an 
estimate of general ability. Here he draws 
heavily from Scripture’s 1891 article on 
‘“Arithmetical prodigies’ in the American 
Journal of Psychology, and from Mitchell's 
1907 article on “Mathematical prodigies” in 
the same Journal. As most of the cases re- 
ported upon antedated scientific psychology, 
their histories, with a few notable exceptions, 
are sketchy and poorly documented. The au- 
thor cites uncritically hear-say evidence, ar- 
ticles from old newspapers and popular maga- 
zines, and writers on psychic research. He 
also has a few systematic biases, including: 
(1) the usual bias of one who has dabbled in 
psychic research; (2) an admitted “instinc- 


256. 
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tive dislike of precocious children”; (3) a 
tendency to exaggerate the one-sidedness of 
prodigies and to underestimate their general 
ability. The third of these may be an out- 
come of the second. For example, the Bel- 
gian boy Verhaeghe is described as “an ado- 
lescent of seventeen with the mental age of a 
babe of two years.” Yet this boy, when ex- 
amined by a committee of mathematicians in 
1946, gave the fourth power of 1,246 in 10 
seconds, the sixth root of 24,137,585 in 25 sec- 
onds, and the square of 888,888,888,888,888 
in 40 seconds! 

The arithmetical prodigies whose nationali- 
ties are given distribute as follows by coun- 
try: Britain 10, France and Italy 7 each, 
United States 5, Germany 2, and 1 each for 
India, Ceylon, Greece, Belgium, Spain, Swit- 
zerland, Egypt, and Mexico. Britain’s lead 
is no doubt due to the fact that the author 
has covered his own country more thoroughly 
than other parts of the world. Of the United 
States’ five, two were Negro slaves (one of 
them born in Africa), and two were from the 
little state of Vermont. The author’s list in- 
cludes two very famous scientists (Gauss and 
Ampere), a father-son pair (George P. Bid- 
der, Sr. and Jr.), and six university graduates 
(both Bidders, Gauss, Ampére, the American 
Safford who became a professor of astronomy, 
and Whately, an Archbishop of Dublin). Sev- 
eral others gave evidence of superior general 
intelligence. At the opposite extreme three 
were considered mental defectives, though the 
basis for such classification is dubious in two 
of the three cases. Several described as dull 
were almost certainly well above average in 
general ability. Of the 41 arithmetical prodi- 
gies, four were sheep herders in childhood, 
two were blind, two had 12 fingers and 12 
toes, and one was born without legs or arms. 
The relatively high incidence of sheep herd- 
ing and of physical anomalies is hardly ex- 
plicable in terms of chance, nor is the sex 
ratio of 39 males to 2 females. 

The book would have been more acceptable 
to psychologists if it had included only the 
chapters on History and Data (58 pages), 
The Calculations Considered (15 pages), De- 
velopment (6 pages), Famous Memorizers 
(19 pages), Mnemonics (9 pages) and Men- 
tal Magic (53 pages). The remaining hun- 
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dred pages are a hodgepodge of naive com- 
ment on such topics as heredity and instinct, 
mental imagery, chess and musical prodigies, 
precocity and genius, and the subconscious. 

The book is entertainingly written. The 
authenticated feats of calculation and memory 
which the author has recounted are fascinat- 
ing and astonishing. The chapters on mental 
magic will intrigue many readers by the reve- 
lations given about such things as naming the 
day of the week on which a dated event 
occurred or will occur; short-cut methods for 
a great variety of computations, including 
among others squaring, cubing, root extrac- 
tion, translating months or years into seconds 
and miles into inches or barleycorns; and di- 
rections for carrying out such parlor stunts as 
“think of a number,” “draw any card,” “a 
loan and a present,” “change for a shilling,” 
and numerous others. By showing that many 
feats which appear so difficult can be mas- 
tered by almost anyone with a moderately 
high IQ and a fair memory, these chapters 
can be expected to increase the number of 
amateur mathemagicians whose performances 
will probably amuse, mystify, and bore us in 
about equal proportions. 


Lewis M. Terman 
Stanford University 


Dunsmoor, C. and Davis, O. How to choose 
that college. Boston: Bellman Publishing 
Co., 1951. Pp. 51. $.90 (cloth bound). 
The rapidly expanding number of students 

considering college training makes the need 
for materials to assist them with their choices 
increasingly urgent. This book was written 
for high school students and their parents to 
discuss many of the questions which they 
typically have. It is simply written and at- 
tractively illustrated. The authors systemati- 
cally consider, among other things, such prob- 
lems as college requirements, application, 
financial plans, and making good once ad- 
mitted. This is quite an order for fifty-one 
pages. 

To cover this ground, the authors rely 
heavily on lists of things to do and avoid, on 
typical recommended high school curricula, 
considerable oversimplification, and frequent 
suggestions to see a counselor. The book 
would, therefore, seem to be best suited for 
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use in a guidance class; without expert fill-in, 
most students and their parents would prob- 
ably either be left with unanswered questions 
or be misled. 

Counseling plays an interesting dual role in 
this book. On the one hand, the student is 
left in rather large measure to decide for him- 
self whether he has the right goals, interests, 
and abilities. This is in spite of the ample 
available evidence regarding the tendency to 
appropriate to the self desirable character- 
istics in such circumstances. On the other 
hand, the student is sent to the counselor for 
such things as assistance with writing of let- 
ters of application and, immediately on re- 
ceipt of acceptances, for “review” of these. 
This suggests a dependency likely to plague 
college officials and counselors later on. 

Properly handled, this book should make a 
useful contribution to the literature on guid- 
ance. But, because it has been almost over- 
simplified and condensed, it is doubtful 
whether it should be turned over to students 
as the sole and sufficient guide through a diffi- 
cult terrain. John W. Gustad 

University of Maryland 


Argyris, C. An introduction to field theory 
and interaction theory. New Haven: Yale 
Labor and Management Center, 1952. Pp. 
71. $1.00. 


This brief 71-page pamphlet was originally 
prepared for members of the Labor and Man- 


agement Center at Yale University. Pre- 
sented in each case are some basic founda- 
tions of each theory, some assumptions under- 
lying each theory, some of the goals of each 
theory, some basic operations suggested by 
each theory, and some of the more important 
concepts utilized in each theory. The writ- 
ing is clear in so far as the somewhat turgid 
language of the authors, whose work is sum- 
marized, makes that possible, and simple in 
so far as the extreme complexity of the theo- 
ries discussed allows. As a presentation of 
field theory and interaction theory, therefore, 
this book may be recommended. 

There are several points, however, on which 
the critical reader may well feel uneasy. In 
the first place, the author makes no attempt 
to link up the two sets of theories he is deal- 
ing with. Is field theory compatible with 


interaction theory? Do they deal with the 
same aspects of human behavior? Are there 
alternative descriptions of similar phenomena? 
Is there any evidence of an experimental kind 
to make a choice between them possible? No 
information is given on these vitally impor- 
tant points. 

Again, in what way do the concepts and 
ideas of Lewin, on the one hand, and of Chap- 
ple, Arensberg, Whyte, and Homans, on the 
other hand, constitute a theory? In science 
the term theory is ordinarily used to denote 
a system of hypothetical constructs or inter- 
vening variables which enables us: (a) to 
summarize existing knowledge; and (b) to 
make deductions leading to testable predic- 
tions. This clearly is not the purpose of 
either field or interaction theory. Both are 
essentially semantic attempts, occasionally 
leavened by the use of unorthodox mathe- 
matics, to persuade the reader to accept un 
proven views and to make use of complex 
ways of stating what often appear to be ob- 
vious, commonsense notions. Argyris never 
comes to grips with the problem of proof and 
disproof of theories of this kind, nor does he 
attempt to show that they have a function to 
perform which could not equally well be per- 
formed in other ways. 

This failure to provide any form of critical 
discussion is the major weakness of the book. 
The unwary reader might think from Argyris’ 
presentation that Lewin’s use of topological 
concepts, or hodological space, is acceptable 
to orthodox mathematicians. This, as far as 
I know, is not so, and one might have ex- 
pected at least a brief reference to criticisms 
of these, as of many other points. A book of 
this kind will not be very useful to the initi- 
ated, who will be familiar with its contents in 
any case; nor will it help the uninitiated to 
obtain a balanced view of the theories pro- 
posed. The habit of stating a position with- 
out answering important criticisms of that po- 
sition, or even mentioning that such criticisms 
exist, is unfortunately widespread in psychol- 
ogy. This book is an outstanding example of 
what, to the reviewer, appears to be a very 
bad practice indeed. 

H. J. Eysenck 

Psychology Department, Maudsley Hospital 

London, England 
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Editor, Department of Psychology, University of Minnesota, Minneapolis 14, Minnesota 


Introduction to the Rorschach technique. 
Robert M. Allen. New York: Interna- 
tional Universities Press, Inc., 1953. Pp. 
126. $3.00. 

Introduction to exceptional children. 
vised edition. Harry J. Baker. 
York: Macmillan, 1953. Pp. 500. 

Social psychology. Hubert Bonner. 
York: American Book Co., 1953. 
$4.25. 

Progress i clinical psychology. Vol. I, Sec. 
1. Daniel Brower and Lawrence E. Abt, 
Editors. New York: Grune and Stratton, 
1952. Pp. 328. $5.75. 

The individual and world society. P. FE. 
Corbett. Princeton: Center for Research 
on World Political Institutions, Princeton 
University, 1953. Pp. 59. Gratis. 

The MMPI: a review. William C. Cottle. 
Lawrence, Kansas: School of Education, 
Univer. of Kansas Publ., 1953. Pp. 82. 

Logic and language. Second series. A. G.N. 
Flew, Editor. New York: Philosophical 
Library, 1953. Pp. 242. $4.75. 

The Grassi Block Substitution Test for meas- 
uring organic brain pathology. Joseph R. 
Grassi. Springfield: Charles C Thomas, 
Publisher, 1953. Pp. 75. $3.00. 

Initiating and administering guidance services. 
S. A. Hamrin. Bloomington, Illinois: Mc- 
Knight and McKnight, 1953. Pp. 220. 
$3.00. 

Introduction to statistical methods. Palmer 
O. Johnson and Robert W. B. Jackson. 
New York: Prentice-Hall, 1953. Pp. 394. 

Heredity in health and mental disorder. 
Franz Josef Kallmann. New York: W. W. 
Norton Co., Inc., 1953. $5.00. 

Problem drinkers can be helped. G. N. 
Lansdown. Devon, England: Arthur H. 
Stockwell Limited, 1953. Pp. 72. 

Psychology of industrial relations. C. H. 
Lawshe. New York: McGraw-Hill Book 
Co., Inc., 1953. Pp. 350. $5.50. 

Comparative conditioned neuroses. 
Waldo Miner, Editor. 
York Acad. of Sci., 1953. 


Re- 
New 
$5.00. 
New 
Pp. 439. 


Roy 
New York: New 
Pp. 379. $3.50. 


The natural superiority of women. Ashley 
Montagu. New York: The Macmillan Co., 
1953. Pp. 205. $3.50. 

God, labor and management. Alfred Morgan. 
New York: The William-Frederick Press, 
1953. Pp. 28. $1.00. 

Group psychotherapy. Florence B. Powder- 
maker and Jerome D. Frank. Cambridge: 
Harvard Univer. Press, 1953. Pp. 615. 
$6.50. 

The conception of disease. Walther Riese. 
New York: Philosophical Library, 1953. 
Pp. 120. $3.75. 

The universe of meaning. Samuel Reiss. 
New York: Philosophical Library, 1953. 
Pp. 227. $3.75. 

Philosophy and the ideological conflict. 
Charles S. Seely. New York: Philosuphi- 
cal Library, 1953. Pp. 319. $5.00. 

The retention of meaningful material. Jo- 
seph Francis Sharpe. Washington, D. C.: 
Catholic University of America Press, 1952. 
Pp. 66. $1.00. 

Capitalism overhauled. Job Socius. New 
York: The William-Frederick Press, 1952. 
Pp. 79. $2.00. 

Introduction to testing and the use of test re- 
sults in public schools. Arthur E. Traxler, 
Robert Jacobs, Margaret Selover and 
Agatha Townsend. New York: Harper 
and Brothers, 1953. Pp. 113. $2.50. 

Retirement and the industrial worker. Jacob 
Tuckman and Irving Lorge. New York: 
Bureau of Publications, Teachers College, 
Columbia Univer., 1953. Pp. 105. $2.75. 

The science of color. Committee on Color- 
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APPLIED PSYCHOLOGY 
By HAROLD E. BURTT, Ohio State University 


@ A highly readable text which combines experimental and clinical approaches to describe in 
intelligible style the contributions of psychology to American culture. Called an exceptionally 
adequate description of psychology at work in its currently most important fields, the treat- 
ment embodies an organization and analysis of all major research. Tt is distinctive in inte- 
grating various fields as well as in covering particular areas. 


821 pages + 6" 29" + 1948 


APPLIED PSYCHOLOGY—Abridged Edition 


By HAROLD E. BURTT, Professor of Psychology and Chairman of Department 
of Psychology, Ohio State University 


@ Shortened by half and accelerated in readability, this version of Burtt’s APPLIED PSY- 
CHOLOGY (see above) is designed for an average college course. It adequately covers ap- 
plications in education, medicine, law and business—omits marginal material which is treated 
comprehensively in the original. 

@ The Abridged Edition shows the student what psychologists are doing in a practical way in 

ublic schools, clinics, social agencies, juvenile courts, employment agencies, factories, and 
usiness offices. 


465 pages + 54%" 28%" + July 1952 


COUNSELING AND PSYCHOLOGY: Vocational Psychology and Its 
Relation to Educational and Personal Counseling 


By MILTON L. BLUM and BENJAMIN BALINSKY, College of the City of 
New York 


@ This a treatment combines major viewpoints on counseling and guidance in a systematic 
approach. 


@ Explains all aspects of the guidance process and treats theory in direct relation to applications. 
Illustrative cases are drawn from the authors’ own files. 


@ Coordinates basic J pase mg principles with such tools of oe as vocational, educa- 
c 


tional and person 


counseling, vocational tests, interest class 
formation. 


ations, and occupational in- 
586 pages + 5144" 28%" + Published 1951 
THE COUNSELING INTERVIEW 
By CLIFFORD E. ERICKSON, Dean of Michigan State College 


@ A practical, common-sense text on ways to develop skill in interviewing, this text examines 
all aspects of the interview situation, makes concrete suggestions, and provides case materials 
for class discussion. 
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